Jul 2026
OPOD: On-Policy Omni Distillation
On-Policy Omni Distillation (OPOD), which consolidates text, image, and audio teachers into one omni model, and surpasses the base model and pooled RL training on all twelve benchmarks, and ranks first or second on eleven even when the teachers are included.
Tong Zhao, Yuyang Hu, Reed Li et al.
· arXiv.org · 0 citations