Showing 1–4 of 4 · #architecture
AGENTSDo you need an AI agent, or just a workflow?
Agents decide their own steps; workflows follow yours. A decision guide for choosing the simplest architecture that solves the problem.
RKRafael KimNov 05 · 6 min
PAPERSSparse attention explained: sliding windows, global tokens and block sparsity
Why full attention gets expensive, and the three main ideas that make long contexts affordable, with the trade-offs each one makes.
SPSana PatelOct 29 · 6 min
MODELSContext windows are not memory
A bigger window lets a model read more at once. It does not make it remember, prioritise or forget well. How to design for that difference.
MOMira OkaforOct 09 · 6 min
PAPERSMixture of experts, without the hype
Many parameters, few used per token. How MoE routing works, what "active parameters" really means, and the trade-offs for anyone running or buying these models.
MOMira OkaforSep 14 · 6 min