LLM Value Function RL is introduced, which uses the pretrained knowledge and in-context learning ability of an LLM to estimate policy-aware state values without finetuning a separate critic, and consistently and substantially outperforms both GRPO and PPO.
Kai-Jie Zhu, Wei-Xiang Yan, Omar Attia et al.· 1 citation
RLTL;DR is introduced, a promising compacted training paradigm of the form"on this sort of task, keep this sort of thing in mind", which it is hoped will inspire future research on.
Michael Kirchhof, Eleonora Gualdoni, Andrew Szot et al.· arXiv.org· 1 citation
Training API-calling large language model (LLM) agents demands massive amounts of high-quality trajectories. However, collecting such data at scale typically requires fully implemented environments with executable APIs and realistic, pre-populated backend databases, creating a major bottleneck for scalability. To overc...