This work proposes NOSA, a trainable sparse attention mechanism natively designed for KV cache offloading that explicitly constrains the volume of CPU-GPU KV transfers, thereby achieving low communication overhead and high decoding throughput.
Yu-Xiang Huang, Peng-Jie Wang, Ji-Cheng Han et al.· arXiv.org· 4 citations· ⚡1
MathForm is introduced, an autoformalization framework for constructing verified training data through Mathlib knowledge retrieval and verification-guided iterative refinement, and outperforming multiple specialized 32B autoformalizers.
Lushi Pu, Weiming Zhang, Xinheng Xie et al.· 0 citations
UltraX is proposed, a function-calling refinement framework for large-scale pre-training data that completes the editing function space by introducing insertion in addition to deletion and modification, enabling fine-grained instance-level editing.
Xinlong Zhao, Dongsheng Liu, Hengyu Zhao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.