Topic, page 4

AI

Page 4 of articles on AI.

3 min read

The ReAct loop in practice, and where it frays

Reason, act, observe, repeat is the shape almost every agent uses. Its weaknesses are structural, and they show up in the same three places every time.

AIAgentsPrompt EngineeringLLMs
Read post
3 min read

Tokens are the unit your system is actually measured in

Cost, latency and the point at which text gets cut off are all counted in tokens. Reasoning about the system in words will mislead you in all three.

AILLMsPerformanceArchitecture
Read post
4 min read

Tool calling is an API design problem, not a prompt problem

When an agent misuses a tool, the instinct is to rewrite the prompt. Usually it's the tool's own signature that made the mistake available in the first place.

AIAgentsMCPArchitecture
Read post
4 min read

Tracing an LLM system so failures stay diagnosable

Request logs tell you a call succeeded. For a model-driven system the useful record is the whole chain, because the mistake is rarely in the last step.

AIObservabilityEvaluationArchitecture
Read post
3 min read

Putting a vision model somewhere it has to keep up

A model that describes an image accurately is not yet a system. Frame rate, cost per frame and what happens on a wrong answer decide the architecture.

AIMultimodalArchitecturePerformance
Read post
4 min read

What a larger context window does not fix

A million-token window suggests you can stop being selective about context. Attention is uneven across a long window, and cost scales with what you send.

AIContext EngineeringLLMsPerformance
Read post
4 min read

What embeddings actually encode, and what they miss

Embeddings capture how text is used, not what it means. That distinction explains most of the retrieval failures that look inexplicable from the outside.

AIEmbeddingsRAGSystem Design
Read post
4 min read

What actually makes a system an agent

Most things called agents are workflows with a model bolted on. The line is whether the system picks its own next step, and everything difficult follows.

AIAgentsLangGraphArchitecture
Read post
4 min read

What MCP actually standardises, and what it leaves to you

MCP gets described as USB-C for AI tools. The useful question is narrower: which parts of tool integration stop being your problem, and which never were.

AIMCPAgentsArchitecture
Read post
3 min read

What self-hosting a model actually costs

Running a model locally is free in the sense that a server is free. The bill is idle capacity, and the arithmetic decides this more than principle does.

AILLMsPerformanceArchitecture
Read post
4 min read

What you are exposing when you add an MCP server

An MCP server turns an internal API into something a model calls on its own initiative. The threat model changes, and the existing auth boundary rarely fits.

AIMCPSecurityArchitecture
Read post
4 min read

When not to build an agent

Most problems described as agent problems are retrieval, a workflow, or a form. Agents earn their cost in a narrow band, and it pays to know where it starts.

AIAgentsArchitectureSystem Design
Read post

Have a system to build?

Whether it needs designing from scratch or rescuing from its own success, tell me what you’re building and I’ll tell you how I’d architect it.

Open to remote and hybrid work worldwide