Home/Archive/Agents

The archive

48 posts
Showing 1–4 of 4 · #reliability
AI agent failure modes: a field guide and postmortem templateAGENTS

AI agent failure modes: a field guide and postmortem template

Wrong arguments, irreversible actions, runaway loops and confident false success. How agents fail, how to investigate it, and which guardrail stops each failure.

RKRafael KimNov 03 · 7 min
Tool-use evals are broken. Here's how to fix them.AGENTS

Tool-use evals are broken. Here's how to fix them.

Exact-match grading, single runs and perfect mock APIs make tool-use scores look better than reality. A better harness design, step by step.

JLJonas LindOct 11 · 6 min
Step budgets and stopping rules for AI agentsAGENTS

Step budgets and stopping rules for AI agents

Every agent needs to know when to stop. Budgets, loop detection, progress checks and graceful exits that keep agents useful and affordable.

MOMira OkaforSep 25 · 6 min
Evaluating AI agents end to endAGENTS

Evaluating AI agents end to end

Outcome checks, trajectory review, sandboxes, simulated users and pass^k. A complete method for knowing whether your agent really works.

MOMira OkaforJul 14 · 6 min

Get the Sunday Diff — every post worth reading, once a week.