Mark Korotin
Agent Systems

Designing agents that fail gracefully

Runtimes that recover predictably and keep humans in control of consequential actions.

Working · 9 min read

An agent that never fails is a demo. An agent that fails gracefully is a product.

Graceful failure is not a feature you add at the end. It is a design constraint you start with. The question is not "what does this agent do?" but "what does this agent do when things go wrong?" — and more importantly, "what does it do before it makes things worse?"

The hardest part of agent design is not the capability — it is the boundary. Where does the agent act autonomously and where does it stop and ask? This boundary is not a technical decision. It is a product decision, a trust decision, and an organizational decision.

Get it wrong and you have an agent that either does too little to be useful or too much to be safe.