CheatBench: Measuring Reward Gaming in AI Agents
Reinforcement learning has helped AI agents solve increasingly difficult tasks, but high rewards do not always reflect the work users intended. In recent incidents and controlled evaluations across the AI industry, agents trained to maximize reward have accessed unauthorized information, attempted to evade monitoring s...
Long Phan, Stephen K. Yang, Jason J. Lim et al.
· 1 citation