TESTSHow to test whether an AI model really reasons: the contradiction-trap eval
A planted contradiction, blind judges and zero partial credit. A step-by-step method for finding out whether a model tracks state or just sounds like it does.
PROMPTSThe "red-team yourself" prompt: self-critique that works, and when it backfires
Asking a model to attack its own draft can catch real errors, or talk it out of a right answer. What the research says, and the variants worth using.
TESTSWhat do reasoning tokens actually cost you? How to measure and control them
Hidden thinking tokens are billed like output and vary wildly by task. A practical audit to find where reasoning pays off and where it is burning money.
TESTSDoes "think step by step" help on short tasks?
Chain-of-thought helps a lot on maths and logic and very little on many everyday tasks. What the research says and how to check your own workload.
PAPERSChain of thought and self-consistency, revisited
Write the steps, sample several paths, take the majority answer. The ideas behind modern reasoning, what still works, and what reasoning models changed.