Reinforcement learning with verifiable rewards (RLVR) has become a standard recipe for post-training vision-language models (VLMs), but it typically assumes a static training environment. As the actor improves, fixed tasks drift out of its learning frontier: many become trivial, others remain unsolvable; and the learni...
Meng Lu, Li-Geng Zhu, Olivia C. Xiao et al.· 0 citations
Deploying a language model under different computing and latency budgets calls for compact models with different quality-cost trade-offs. Towards this end, elastic spectral state space models provide ordered and temporally decomposed channels that can be truncated, but they are associated with linear time-invariant fil...
Da-Chuan Song, Chu-Chu Chen, Xuan Wang· 0 citations
Elastic Spectral State Space Models is proposed, a train-once, export-many sequence modeling framework that gains elasticity through spectral approximation of the SSM sequence operator that can be truncated to competitive compact models compared with modern Transformer and SSM baselines at similar parameter scales.
Da-Chuan Song, Ju Yin, Ze-Chen Hu et al.· 1 citation
A model-side aggregation interface is introduced that maintains compact Hash-based HyperLogLog sketch states alongside a frozen language model that improves over direct full-context reasoning over chain-of-thought reasoning.
Da-Chuan Song, Ju Yin, Ze-Chen Hu et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.