Long-horizon research agents must decide both how to investigate and what to investigate next as evidence accumulates. This is hard to learn because such decisions are sparse in long execution traces, and their consequences may emerge several investigations later. We introduce Meta-reasoning for Iterative Research Agen...
Ankur Samanta, Yonathan Efroni, Paul Sajda et al.· 0 citations
Looped transformers and Mixture-of-Experts (MoE) offer complementary routes to efficient scaling: recurrence increases computational depth at fixed parameters, while MoE sparsity expands total capacity at fixed active compute. Yet existing scaling laws model recurrence or sparsity in isolation. In this work, we introdu...
Meta-reasoning, an inference-time harness that makes agentic meta-reasoning an explicit and structured reasoning process, keeps improving over the tested budget ranges where direct control plateaus, though its overhead can hurt at small budgets.
Paras Dahal, A. Bakhtin, Taco Cohen et al.· 0 citations
The database community has repeatedly advanced the state of the art by recognizing that new workloads demand new system architectures. We argue that long-horizon agentic tasks -- code generation, scientific discovery, hardware design -- are such a workload. These agents explore: they generate artifacts, execute tools,...
Gang Liao, Yujia He, Abdullah Ozturk et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.