On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models

Published 27 October 2026

A language model can improve itself by generating its own questions, answers, and reasoning examples from only broad topic descriptions. This data-free training improves performance across text and visual tasks while preserving abilities in areas not used for training.