Large language model (LLM) agents are rapidly improving on long-horizon scientific and olympiad tasks. Recent systems have produced a Lean-formalized resolution of the Navier--Stokes problem and autonomous solutions to four open questions in the Erd\H{o}s Conjectures database. Yet neither system releases both its under...
Zhengyang Zhang, Jing Xiong, Hongzhou Lin et al.· 0 citations
Reinforcement Learning from Verifiable Rewards (RLVR) is a key driver for Large Reasoning Models, but it is vulnerable to "zero-reward collapse", a training failure where a sudden increase in task difficulty causes the learning signal to vanish. We argue that the conventional approach of discarding these failed traject...
Guanlan Yue, Hang Yu, Xiaoyong Huang et al.· 0 citations
Reasoning models can benefit from test-time scaling, but continued reasoning may become ineffective or harmful, a phenomenon termed overthinking. Evaluations against full thinking compare accuracy and token usage but lack references for overthinking severity and strategies' theoretical mitigation potential. To characte...
Weixin Guan, Liang Li, Shiyu Xie et al.· 0 citations
Long-horizon embodied agents must maintain task-relevant information, coordinate heterogeneous robots, and adapt their decisions as execution unfolds. Existing benchmarks investigate dynamic task execution and embodied multi-agent coordination, but provide limited evaluation of their intersection. We introduce MAGMA-Be...
Loan Bernat, Matthieu Grard, Ariane Herbulot et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Multi-teacher on-policy distillation (MOPD) extends on-policy distillation (OPD) by routing domain-specific data to specialized teachers, integrating their capabilities through dense token-level supervision on student-generated trajectories. However, domain routing only distinguishes the supervision sources for differe...
Shi-Yu Tian, Yong Liu, Ximan Liu et al.· 0 citations
Identifying causal effects from observational data typically requires a fully specified causal graph, an assumption that is often unrealistic in complex or high-dimensional settings. Causal abstractions address this limitation by retaining only partial causal information, thereby defining equivalence classes of compati...
Clément Yvernes, Marianne Clausel, Emilie Devijver et al.· 0 citations
Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRISM (Population-Retrieved Inference for Structured Multimodal Prognosis), a multimodal language model that combines per-feature numerical tokenization, recency-weighted...
Hamza Shafiq, Jia-Lu Tang, Ting Dang et al.· 0 citations
Existing LLM-based agent approaches for long-horizon machine learning engineering (MLE) often use context engineering, implemented through custom harnesses that manage tools, skills, and accumulated experience. However, we find that as single-session execution lengthens, the agent's reasoning intensity declines alongsi...
Changye Li, Zijian Zhang, Muheng Li et al.· 0 citations
On-policy distillation (OPD) provides teacher supervision on student-generated trajectories, but a single trajectory realizes only one continuation at each decision, limiting supervision coverage under a finite sampling budget. We propose BranchOPD (Branching On-Policy Distillation), which selects informative decision...
Dong-Yang Chen, Shudong Liu, Shu-Bo Li et al.· 0 citations
Generating edge case scenarios is crucial for training, testing and safety assuring autonomous systems. This identifies hazardous failures to increase system reliability and robustness, ensures the system can still function safely on the boundaries of its operational design domain and learns the expected system behavio...
Victoria J. Hodge, Colin Paterson, Rob Alexander· 0 citations
AI systems are making rapid progress in mathematics, but this progress is hard to measure. Benchmarks of solved problems saturate, and in benchmarks of open problems each problem can be resolved for the first time only once. We present SqueezeBench, a benchmark that is resilient to saturation: a success raises the bar...
Pablo Manrique, Hai Xia, Stefan Szeider· 0 citations
Large language models (LLMs) have taken the world by storm. Their ability to communicate with us in our own language, and to reason about our world, has made them a favorite tool for writing, answering questions, and much more. Their answers already influence our decisions and our actions. What would happen if LLMs the...
Max van Duijn, Michiel van der Meer, Aske Plaat et al.· 0 citations
