EAGLE-4 Speeds Up LLM Inference with Adaptive Speculative Decoding

Published 22 October 2026

Official inference code for EAGLE-4, a flexible speculative decoding system that adapts draft trees to hardware, batch size, and workload. The eagle-harness package integrates with SGLang, vLLM, and TokenSpeed while preserving the target model's outputs.