Skip to content
Preprint

HELIX: Model-Harness Co-evolution for Recursive Self-Improvement

Aug 2026 · 7 citations · ⚡ 1 influential · 25 references
Computer Science

TL;DR

HELIX provides an auditable interface for studying model-harness co-evolution for recursive self-improvement and expands current capability and creates learning signal for the next model; model updates motivate the next round of harness evolution.

Abstract

Scaling agent capability has largely focused on improving the model, yet an interactive agent acts through a runtime harness that mediates context, tools, control flow, and stopping. The harness shapes both what a model can accomplish and the trajectories from which it learns. This coupling motivates model-harness co-evolution for recursive self-improvement: build harnesses for a fixed model, update the model from verified sibling trajectories, and rebuild the harnesses as model capabilities change. Realizing this loop requires a controlled way to evolve harnesses while preserving intervention identity and effect. We present HELIX, a source-traceable substrate for harness evolution. HELIX decomposes agent systems into typed ports, reusable atoms, recipes, product shells, and runtime policies. It makes interventions explicit and auditable while retaining trajectories, test outcomes, and provenance. Harness evolution thus serves two linked roles: improving fixed-model execution and producing matched successes, regressions, near misses, and alternative solutions as data for subsequent model improvement. We evaluate HELIX in one evolution round on code repair. A 65-candidate portfolio discovers a fixed harness that improves task coverage by 4.0% over Pi, while the full portfolio exposes up to 58.0% more verified coverage through complementary sibling behavior. Selected candidates are assessed with repeated runs and the SWE-bench evaluator. A 200-slot sibling slice yields 438 verified SFT, critic, filter, and preference records. These results show how harness, model, and data form a feedback system: harness evolution expands current capability and creates learning signal for the next model; model updates motivate the next round of harness evolution. HELIX provides an auditable interface for studying this recursive process. Code is available at https://github.com/HKUDS/HELIX.

View source

Similar papers

Preprint Aug 2026

One Recipe, Many Harnesses: What Self-Evolution Encodes Across Languages and Models

Together, these results recast the evolved harness as a legible compensation layer, shaped jointly by the language's engineering demands and the model's behavioral gaps, rather than an opaque benchmark-tuned scaffold.

Siqi Yang, Qianlan Yang, Yu-Xiong Wang et al. · 2 citations
Preprint Aug 2026

HarnessCompass: Guiding Automatic Harness Evolution toward Generalizable and Effective Agent Harnesses

HarnessCompass is proposed, a novel automatic harness evolution framework built around constrained evolution, proactive feedback, and component-wise optimization that improves Pass@1 from 54\% to 66\% in only 5 evolution iterations, outperforming AHE in both effectiveness and evolution efficiency.

Luan Zhang, Ruo-Chen Zhou, Dan-Dan Song et al. · 10 citations · ⚡1
Preprint Jul 2026

DarwinX: Evolving Agent Harnesses Through Natural Selection

DarwinX is introduced, which treats self-evolution as selection over a population of harnesses with the model frozen: a preserve-and-extend contract admits only variants that extend coverage without regressing, an archive keeps alternative lineages for recombination, and failure-, teacher-, and self-derived evidence sh...

Yifang Zhang, Yutong Dai, Juntao Tan et al. · 2 citations · ⚡1
Jul 2026

Recursive Harness Self-Improvement

Recursive Harness Self-Improvement is introduced, which represents the harness as a prompt-level specification of the agent loop and iteratively refines it using pairwise feedback over its own revision history, suggesting RHI as a practical algorithm for continual learning within the paradigm of model--harness co-evolu...

Hyunin Lee, Jinglue Xu, Jeffrey Seely et al. · 10 citations
Preprint Aug 2026

SHE: Trajectory-driven Safety Harness Evolution for LLM Agents

Safety Harness Evolution (SHE) is proposed, a framework that learns evolving safe boundaries from rollout trajectories and introduces an attribution-guided evolution loop that converts trajectory failures into structured diagnoses, learns artifact-specific boundary refinements, and selects evolved harnesses through saf...

Wanying Qu, Qing-Hua Mao, Yu Li et al. · 5 citations
Preprint Jul 2026

Don't Blame the Large Language Model: How Agent Harness Evolution Shapes Coding Agent Quality

This paper empirically study the development and release evolution of five major open-source agent harnesses, revealing extreme release velocities exceeding two releases per day and thousands of issues within months, and performs the first controlled longitudinal study that isolates the agent harness contribution.

O. Sghaier, Hao Li, Bram Adams et al. · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.