When Do We Need On-Policy Distillation? Distilling on Offline Student Rollouts Is Often Better

Published 13 October 2026

Distilling from offline rollouts generated by the initial student can improve accuracy and training efficiency, with the best method depending on teacher-student alignment.