Home/Archive

The archive

48 posts
Showing 1–2 of 2 · #quantization
Oct 28MODELSQuantization without tears: what you lose at 8, 4 and 3 bits6 min ↗Oct 26TESTSHow to run an 8B LLM on a laptop: hardware, quantization and tools6 min ↗

Get the Sunday Diff — every post worth reading, once a week.