CatalEx Engineering

Every team that builds seriously with AI walks the same road, usually without noticing. It starts with a chat window and a good feeling, and — if the work survives contact with production — it ends somewhere far more disciplined. This is a field note on that road: the three stages we see teams pass through, what each one is genuinely good at, and the specific failure that forces the jump to the next.

"Give the agent memory" is one of those phrases that sounds like a feature and is actually an architecture. Everyone agrees agents should remember things across sessions. Almost no one agrees on what that means — and the default implementation, a vector database that everything gets dumped into, produces agents that are confidently wrong about their own past.

Every team that has tried to ship an AI feature has hit the same wall. The demo works. A stakeholder asks, "is it good?" and the honest answer is a shrug. You feel like it's good. You changed a prompt and it feels a little better, or a little worse, and you cannot say which, because "feels" is the only instrument you have.

The most expensive misconception in applied AI is that performance lives in the model. Pick the best model, the thinking goes, and the rest is glue. So teams spend their attention on which model to call and treat everything around it — the tools, the loop, the context they assemble, the way they check the output — as plumbing.

There's a tidy argument going around: skip the Model Context Protocol, just give the agent a shell and a CLI. No server to run, no schemas to maintain, and — the clincher — it saves tokens, because a command is short and a tool definition is long. It's a good argument. It's also only half right, and the missing half is where most of the cost actually lives.

If you want to understand why AI works the way it does today, you don't need to read a hundred papers. You need to read about five, in order, and understand what each one changed. Everything since is, to a first approximation, a refinement or a scaling-up of ideas these introduced.

When you build software with an AI agent day to day, the thing you run out of first isn't intelligence — it's context. The window is finite, attention inside it isn't free, and a session that starts sharp gets duller as it fills with the exhaust of the work: verbose command output, whole files read to find one function, stale documentation, the residue of three tasks ago.

Here is a shift that has already happened, whether or not your documentation noticed: a large and growing share of the readers of everything you write are no longer human. They're language models — reading your docs to answer a question, your README to use your library, your marketing page to tell someone what you do. Andrej Karpathy has been making this point for a while, and it lands harder every month: the primary reader of a lot of your writing is now an LLM, and you are probably still writing for a human.