This position paper argues that to claim a "long-horizon failure", benchmarks must compare actual full-task success against a baseline prediction built from short, individual stages, and calls the log-ratio between this prediction and actual success the horizon residual.
Conference attendees will experience how DBCooker seamlessly transforms high-level SQL function requests into validated, kernel-ready code for mainstream databases (e.g., SQLite, PostgreSQL, DuckDB).
Wei Zhou, Xuan-He Zhou, Qi-Kang He et al.· Proceedings of the VLDB Endo...· 1 citation
Ledger is proposed, a deterministic runtime layer that distills an agent's completed interactions into an explicit execution state: what has been observed, what has been modified, and what has been attempted, in an online execution ledger and applies it at two boundaries of every step.
Zehao Wang, Yisen Xu, Cheng-Lin Li et al.· 2 citations
This paper is the first to study how SE processes are changing in the development of SE agents and what challenges developers face, and describes a seven-stage workflow and five process shifts, including a move toward evaluation-driven development.
Yunbo Lyu, David Williams, Jieke Shi et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.