This study finds that these “autonomous AI scientists” can introduce systematic methodological pitfalls such as biased evaluation, undisclosed data manipulation, and selective reporting that are not visible in the final manuscript.
Ziming Luo, Atoosa Kasirzadeh, Nihar B. Shah· Proceedings of the National...· 0 citations
A randomized experiment and an anonymous post-survey at ICML 2026 investigate how reviewers use LLM-use policies in practice and how different LLM-use policies affect review outcomes, and discusses implications for future peer-review policy and tool design.
Sunnie S. Y. Kim, W. Deng, Jennifer Wortman Vaughan et al.· 1 citation
The results show that LLM agents, even without executing code, can identify many real-world reproducibility problems from paper-repository pairs, and ReproRepo can serve as a reusable, scalable framework for future evaluations of LLM agents on real-world reproducibility auditing.
Shanda Li, Qiuhong Anna Wei, Jingwu Tang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.