Home/Archive

The archive

48 posts
Showing 1–7 of 7 · #prompting
How to test whether an AI model really reasons: the contradiction-trap evalTESTS

How to test whether an AI model really reasons: the contradiction-trap eval

A planted contradiction, blind judges and zero partial credit. A step-by-step method for finding out whether a model tracks state or just sounds like it does.

MOMira OkaforNov 09 · 7 min
Few-shot examples that don’t backfirePROMPTS

Few-shot examples that don’t backfire

Models copy examples more faithfully than instructions, including their mistakes. How to pick, order and test few-shot examples that help.

MOMira OkaforOct 17 · 6 min
The "red-team yourself" prompt: self-critique that works, and when it backfiresPROMPTS

The "red-team yourself" prompt: self-critique that works, and when it backfires

Asking a model to attack its own draft can catch real errors, or talk it out of a right answer. What the research says, and the variants worth using.

SPSana PatelOct 15 · 6 min
Decomposition prompts for long, messy tasksPROMPTS

Decomposition prompts for long, messy tasks

One giant prompt fails in ways you cannot see. Chaining, map-reduce and plan-then-execute turn long tasks into steps you can test and fix.

JLJonas LindAug 30 · 6 min
Does "think step by step" help on short tasks?TESTS

Does "think step by step" help on short tasks?

Chain-of-thought helps a lot on maths and logic and very little on many everyday tasks. What the research says and how to check your own workload.

SPSana PatelAug 14 · 6 min
Why "don't do X" instructions fail, and what to write insteadPROMPTS

Why "don't do X" instructions fail, and what to write instead

Telling a model what not to do often plants the idea. Why negative instructions misfire, and five rewrites that work better.

SPSana PatelJul 18 · 6 min
Chain of thought and self-consistency, revisitedPAPERS

Chain of thought and self-consistency, revisited

Write the steps, sample several paths, take the majority answer. The ideas behind modern reasoning, what still works, and what reasoning models changed.

RKRafael KimJul 07 · 6 min

Get the Sunday Diff — every post worth reading, once a week.