The archive

48 posts
Showing 1–2 of 2 · #prompting
How to test whether an AI model really reasons: the contradiction-trap evalTESTS

How to test whether an AI model really reasons: the contradiction-trap eval

A planted contradiction, blind judges and zero partial credit. A step-by-step method for finding out whether a model tracks state or just sounds like it does.

MOMira OkaforNov 09 · 7 min
Does "think step by step" help on short tasks?TESTS

Does "think step by step" help on short tasks?

Chain-of-thought helps a lot on maths and logic and very little on many everyday tasks. What the research says and how to check your own workload.

SPSana PatelAug 14 · 6 min

Get the Sunday Diff — every post worth reading, once a week.