The archive

48 posts
Showing 1–1 of 1 · #hardware
How to run an 8B LLM on a laptop: hardware, quantization and toolsTESTS

How to run an 8B LLM on a laptop: hardware, quantization and tools

Memory maths, quantization choices, tool options and a quick way to predict speed. Everything you need to run a capable model locally.

JLJonas LindOct 26 · 6 min

Get the Sunday Diff — every post worth reading, once a week.