The archive

48 posts
Showing 1–3 of 3 · #reasoning
How to test whether an AI model really reasons: the contradiction-trap evalTESTS

How to test whether an AI model really reasons: the contradiction-trap eval

A planted contradiction, blind judges and zero partial credit. A step-by-step method for finding out whether a model tracks state or just sounds like it does.

MOMira OkaforNov 09 · 7 min
What do reasoning tokens actually cost you? How to measure and control themTESTS

What do reasoning tokens actually cost you? How to measure and control them

Hidden thinking tokens are billed like output and vary wildly by task. A practical audit to find where reasoning pays off and where it is burning money.

RKRafael KimOct 07 · 6 min
Does "think step by step" help on short tasks?TESTS

Does "think step by step" help on short tasks?

Chain-of-thought helps a lot on maths and logic and very little on many everyday tasks. What the research says and how to check your own workload.

SPSana PatelAug 14 · 6 min

Get the Sunday Diff — every post worth reading, once a week.