Why full attention gets expensive, and the three main ideas that make long contexts affordable, with the trade-offs each one makes.
