Topic, page 2

AI

Page 2 of articles on AI.

3 min read

Few-shot examples, and the point where they stop helping

Examples are the fastest way to fix a format problem and a slow way to fix a reasoning one. Adding more has a ceiling that arrives earlier than expected.

AIPrompt EngineeringLLMsContext Engineering
Read post
3 min read

Fine-tuning teaches form, retrieval supplies facts

Teams reach for fine-tuning to make a model know their data. It is much better at teaching behaviour, and facts have a cheaper home.

AIRAGLLMsSystem Design
Read post
4 min read

Where personal data ends up in an LLM system

Prompts, traces, embeddings and evaluation sets all quietly become copies of user data, and most of them were never on anybody's data map.

AISecurityObservabilityArchitecture
Read post
3 min read

How AI agents fail in production

Agents rarely crash. They loop, they stop early, and they confidently do the wrong thing, which is why ordinary error handling never catches any of it.

AIAgentsObservabilityEvaluation
Read post
3 min read

How vector indexes trade accuracy for speed

Approximate search is approximate on purpose. Knowing which results you are giving up explains retrieval failures that look like model problems.

AIVector DatabasesPerformanceDatabases
Read post
3 min read

Human review that earns the time it costs

People are the only judges who catch what nobody thought to check for. Spending that attention on random samples wastes most of it.

AIEvaluationObservabilitySystem Design
Read post
3 min read

Hybrid search beats pure semantic search almost everywhere

Vector search handles paraphrase well and exact terms badly. Keyword search is the reverse, and users send both kinds of query in the same session.

AIRAGEmbeddingsPerformance
Read post
3 min read

Keeping a vector index fresh after the launch

Most RAG systems are built against a snapshot and then quietly decay. Indexing is a pipeline with a freshness target, not a one-off import script.

AIRAGEmbeddingsArchitecture
Read post
3 min read

Using a model as a judge, and when to trust the score

Grading output with another model scales in a way humans cannot. It also has biases of its own, and a judge nobody validated is just a number.

AIEvaluationLLMsObservability
Read post
4 min read

Agent memory is three problems wearing one name

Conversation history, retrieved knowledge and learned state all get called memory. They have different lifetimes, and conflating them is why agents drift.

AIAgentsRAGContext Engineering
Read post
3 min read

Metadata filtering is where vector search meets reality

Real queries are never purely semantic. They are scoped to a tenant, a status and a date, and where that filter runs changes the results you get.

AIVector DatabasesRAGArchitecture
Read post
3 min read

Open weight or closed model: the decision is mostly not quality

The capability gap narrows every few months. What does not narrow is the difference in who controls deprecation, data residency and your cost curve.

AILLMsArchitectureSystem Design
Read post

Have a system to build?

Whether it needs designing from scratch or rescuing from its own success, tell me what you’re building and I’ll tell you how I’d architect it.

Open to remote and hybrid work worldwide