Home/Archive

The archive

48 posts
Showing 1–2 of 2 · #training
Scaling laws, in plain EnglishPAPERS

Scaling laws, in plain English

Compute, data and parameters: the three-way trade-off behind every model release, explained without equations you have to memorise.

MOMira OkaforOct 02 · 7 min
Distillation explained for buildersMODELS

Distillation explained for builders

Train a small model to imitate a big one and keep most of the quality at a fraction of the cost. How it works, when it pays off and what to check first.

JLJonas LindJul 30 · 6 min

Get the Sunday Diff — every post worth reading, once a week.