Skip to content
Book Open access

SAGE: Solver-Aligned Guided Exploration

Jul 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · 0 citations · 18 references
Computer Science

TL;DR

SAGE, a modular approach that trains a small searcher model to handle codebase exploration as a tool for a frozen large solver model, is proposed, demonstrating a practical path to cheaper, modular software engineering agents.

Abstract

Modern code agents achieve strong results on challenging software engineering benchmarks such as SWE-bench, but solving each issue remains expensive: most inference cost is spent not on patch generation, but on repository exploration and search, accounting for up to 56% of tokens in our experiments. We propose SAGE, a modular approach that trains a small searcher model to handle codebase exploration as a tool for a frozen large solver model. We first distill the search trajectories from a strong agent to obtain a compact searcher with comparable retrieval quality. We then apply reinforcement learning to optimize the searcher for usefulness under the solver's fixed interface, using step-level feedback that directly evaluates whether retrieved context is actionable for downstream patching. On SWE-bench Verified, SAGE improves resolve rate while reducing search overhead by 67% and overall cost by 21%, demonstrating a practical path to cheaper, modular software engineering agents.

Read PDF

Similar papers

Jul 2026

PerfAgent: Profiler-Guided Iterative Refinement for Repository-Level Code Optimization

PerfAgent is presented, a profiler-guided, verifier-in-the-loop workflow that gives an off-the-shelf coding agent the feedback needed to find real hotspots, improve beyond the first passing patch, and use profiler evidence rather than timing alone to decide what to optimize next.

Ryan Deng, Yuan-Zhe Liu, Bastian Lipka et al. · 2 citations
Jul 2026

LLM-Guided Evolutionary Search for Constraint Model Reformulation to Improve Solver Efficiency

Combinatorial problems appear in numerous industrial applications. A common approach is to formulate these problems as declarative constraint models that can subsequently be compiled to and solved by a range of back-end solvers. Recent work shows that Large Language Models (LLMs) can produce correct models from natural...

Kostis Michailidis, Dimos Tsouros, Dang Nguyen et al. · 0 citations
Preprint Aug 2026

AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces

The proposed AutoSaddler, an automatic harness optimization framework that formulates harness improvement as an offline learning problem and iteratively updates the harness using failure signals from mini-batches, suggests that automatic harness optimization is a promising path toward more performant and reliable agent...

Sungho Park, Wonjoong Kim, Rongyuan Tan et al. · 15 citations · ⚡1
Book Open access Jul 2026

Coding agents for automated metaheuristic design

The results suggest that recent progress in language models and tool use may already be sufficient to support practical automated metaheuristic design, and that recent progress in language models and tool use may already be sufficient to support practical automated metaheuristic design.

Jan Iłowski, Marcin Małek, Wojciech Achtelik et al. · 0 citations
Conference Open access 2026

Uncertainty-Aware Test-Time Search for Optimization Problem Solving

UMCTS is an Uncertainty-aware Monte Carlo Tree Search framework that combines the language understanding capability of large language models with the reliability of well-established solvers and achieves state-of-the-art solution accuracy and improves efficiency by reducing token usage.

Linlin Yu, Xujiang Zhao, Dong Li et al. · 0 citations

Reinforcement Learning for Code Optimization

This work makes execution time learnable through three stages: how code is tested, by building DMC-Optim with large optimization tests and a calibrated sandbox; how speed is turned into reward, by composing correctness and speed in the RL environment and using an offline simulator to predict the most promising configur...

Pierre Chambon, Kun-Hao Zheng, Juliette Decugis et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.