Issue #147 — the contradiction-trap eval is live

Field notes from the frontier of AI.

Hands-on model tests, reproducible benchmarks and battle-tested prompts — written by people who actually read the eval logs.

playground / live-testreasoner-xl
// PROMPT
›
// RESPONSE · 0 tok
latency …temp 0.2verdict running
THE GEEKALICIOUS INDEX · NOV 2026

Our own tests. Not the press release.

01
Atlas-4 ProNorthwind Labs
94.1
02
Claude-class OpusAnthropic
92.8
03
Gemini-class UltraGoogle DeepMind
90.3
04
Orca R2OpenSea AI
86.7
05
Mistral Large 3Mistral
81.2
06
Llama 5 70BMeta
77.9
Scores normalized 0–100 · 3 runs per task · temp 0.2Methodology →

Latest dispatches

All posts →
01TESTSHow to test whether an AI model really reasons: the contradiction-trap eval7 min · Nov 09↗02PROMPTSAnatomy of a production system prompt6 min · Nov 08↗03MODELSHow to evaluate a new AI model in two weeks: a practical review framework6 min · Nov 07↗04BENCHMARKSBuild an LLM eval set in an afternoon6 min · Nov 06↗05AGENTSDo you need an AI agent, or just a workflow?6 min · Nov 05↗06BENCHMARKSBenchmark contamination: how to check whether a model has seen the test6 min · Nov 05↗
PROMPT LIBRARY · 380+ TESTED

Steal these prompts

CODINGworks on 14/14
Test-first bug fix
Bug report: {{bug}} Relevant code: ``` {{code}} ``` 1. Restate the bug as expected vs. actual behaviour. 2. Write a failing test that reproduces it (same framework as the codebase). 3. Explain the root cause in at most 3 sentences, citing line numbers. 4. Provide the smallest fix as a unified diff. 5. List any other places with the same pattern that may share the bug. Do not refactor unrelated code.
4.2k saves
CODINGworks on 11/14
Explain this codebase
Files: {{file_tree}} Key files content: {{snippets}} Write an onboarding guide for a new engineer: - What the system does, in 3 sentences. - Request lifecycle: trace one typical request through the files, in order. - The 5 most important modules and what each owns. - Where to make common changes (add an endpoint, add a field, add a job). - Gotchas: surprising behaviour, implicit conventions, known debt. Reference file paths for every claim. Mark guesses as (unverified).
3.8k saves
CODINGworks on 12/14
Security review pass
Review this code for security issues only: ``` {{code}} ``` Check for: injection (SQL, shell, template), missing authorisation checks, unsafe deserialisation, secrets in code, SSRF, path traversal, weak crypto, missing input validation, sensitive data in logs. For each finding return: severity (critical/high/medium/low), line(s), exploit scenario in one sentence, fix as a minimal code change. If nothing is found in a category, do not mention it. End with: "Not reviewed:" listing what you could not assess from this snippet.
3.5k saves
CODINGworks on 14/14
Diff-only refactor
Return ONLY a unified diff. Do not rewrite unchanged lines. Explain each hunk in one comment above it.
3.4k saves
WRITINGworks on 14/14
Executive summary from a long doc
Document: {{document}} Audience: {{audience}} with 2 minutes to read. Write: 1. Headline: the single most important conclusion, max 15 words. 2. Three bullets: what happened, why it matters, what is decided or needed. 3. The ask: one sentence with a deadline, or "No action needed." 4. Risks: up to 2, each with likelihood and owner. Use numbers from the document; never introduce new ones. Max 150 words total.
3.3k saves
REASONINGworks on 13/14
Assumption audit
You are reviewing a plan before it is executed. Plan: {{plan}} 1. List every assumption the plan depends on (explicit or implicit). Number them. 2. For each assumption, rate: likelihood it is false (low/med/high) and impact if false (low/med/high). 3. For every high-impact assumption, propose the cheapest test that would confirm or refute it within one week. 4. Rewrite the plan so the riskiest untested assumption is checked first. Output sections: ASSUMPTIONS · RISK TABLE · TESTS · REVISED PLAN. No preamble.
3.1k saves
THE SUNDAY DIFF · FREE · WEEKLY

One email. Everything that actually changed in AI.

Read by 48,000 engineers, researchers and the extremely online. No hype, no affiliate links.