PolicyLong is proposed, shifting data construction towards a dynamic on-policy paradigm, by iteratively re-executing data screening (entropy computation, retrieval, and verification) using the current model, which ensures the training distribution tracks evolving capabilities, yielding an emergent self-curriculum.
LongGuard is presented, a framework that evaluates, mechanistically analyzes, and mitigates long-context guardrail failure, and proposes two training-free mitigations - Chunked Detection and Attention-Head Sharpening (AHS) - and a deployment protocol that selects configurations by context length and audit side.
Ziyang Chen, Xing Wu, Songlin Hu· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.