Home/Archive

The archive

48 posts
Showing 46–48 of 48
Evaluating AI agents end to endAGENTS

Evaluating AI agents end to end

Outcome checks, trajectory review, sandboxes, simulated users and pass^k. A complete method for knowing whether your agent really works.

MOMira OkaforJul 14 · 6 min
The LLM eval harness checklist we wish we had on day oneBENCHMARKS

The LLM eval harness checklist we wish we had on day one

Versioned datasets, pinned models, stored outputs, error bars and a CI gate. A checklist for turning ad hoc eval scripts into infrastructure you trust.

MOMira OkaforJul 11 · 6 min
Chain of thought and self-consistency, revisitedPAPERS

Chain of thought and self-consistency, revisited

Write the steps, sample several paths, take the majority answer. The ideas behind modern reasoning, what still works, and what reasoning models changed.

RKRafael KimJul 07 · 6 min

Get the Sunday Diff — every post worth reading, once a week.