Can AI agents carry out research on open scientific problems? We introduce Into the Unknown, a benchmark that provides an agent with a science paper along with a research direction to pursue and tasks it to write a follow-up paper. We work with scientists at US Department of Energy (DOE) national laboratories, who each...
Seungone Kim, Jia-Yi Geng, Young-Jun Lee et al.· 1 citation
EurekaBench is introduced, a cross-domain benchmark that tests AI agents'ability to conduct long-horizon experiments and discover mechanisms that explain observations, and shows that current AI agents often overly fixate on predictive accuracy optimization, surpassing human scientists, while falling substantially short...
Jia-Yi Geng, Zhengxuan Wu, Kevin S. Chen et al.· 0 citations
This work proposes test-time adaptation through human-agent interaction (TAHI), which integrates these signals into agent context and weights, and crystallizes each user's training and evaluation criteria via an evolving rubric module.