Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation
Joint-Output On-Policy Distillation (JO-OPD) is proposed, which distills the model's stronger S2T policy into joint generation using student-generated S2TS trajectories, which reduces OMG across two interleaved generation architectures.
Da-Xin Tan, De-Hua Tao, Chen-Xi Deng et al.
· 0 citations