vLLM Semantic Router: Programmable Model and Compute Selection

Published 16 October 2026

An open decision layer that selects or combines configured models and compute backends for each request. It helps agent harnesses balance quality, latency, cost, and approved deployment locations through programmable policies.