Automated harness optimization can substantially improve LLM agents by iteratively updating their prompts, tool interfaces, and control logic from execution feedback. However, existing methods primarily optimize how the harness is updated while largely fixing which training scenarios generate the feedback that drives t...
Sungho Park, Wonjoong Kim, Jue Zhang et al.· 0 citations
The Prefix-Aware Internal Reward (PAIR), a two-stage model with a frozen hidden-state probe estimating belief-consistency and a lightweight attention-based head correcting it toward grounded correctness, is proposed, enabling dense step-level reward signals for GRPO training without external model calls, ground-truth d...
Wonjoong Kim, Yeonjun In, Sangwu Park et al.· arXiv.org· 5 citations
PQA, a page-level quality anchoring method that guides simulators using a personalized anchor reflecting each user's intrinsic preference standard, is proposed, and experiments show PQA mitigates trait interference and improves the reliability of LLM-based simulator evaluation under activity shifts.
Chae-Ryung Kim, Sein Kim, Hongseok Kang et al.· 0 citations
To address the sequential and evolving nature of time series, the Online Time Series Forecasting (OTSF) task has been extensively studied in multiple domains. Existing research focuses on adapting to non-stationary environments by employing memory buffer-based retrieval strategies. However, we observe that such framewo...
Seungyoon Choi, Hyunchul C. Kim, Jae-Gil Lee et al.· 1 citation
The proposed AutoSaddler, an automatic harness optimization framework that formulates harness improvement as an offline learning problem and iteratively updates the harness using failure signals from mini-batches, suggests that automatic harness optimization is a promising path toward more performant and reliable agent...
Sungho Park, Wonjoong Kim, Rongyuan Tan et al.· 15 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.