#natural language process...
May 2026
Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing
ExACT, a supervision-allocation objective that assigns extra weight to long effective-context targets by inverse frequency within the long tail, supports a supervision-centric thesis: long-context adaptation depends on how strongly training supervises long-context predictions.
Jinchang Zhu, Jindong Li, Chengyu Zou et al.
· arXiv.org · 4 citations