You don't need long context

Published 5 November 2026

Later tokens can cost up to 7 times more than earlier ones in frontier open-weight models. Frequent context compaction keeps contexts short with little or no accuracy loss across long tasks, including software engineering. The results suggest long-context models may not always be necessary.