MechHypoBench is introduced, the first benchmark for evaluating whether AI agents and AI scientists can generate mechanistic hypotheses from empirical data, and an evaluation framework is developed that assesses open-form mechanistic hypotheses through their consequences under withheld conditions.
Xia-Xun Xie, Qing-Qing Long, Meng Xiao et al.· 0 citations
SciHorizon-eLab is introduced, an agentic protocol-to-task compiler that formulates scientific embodied task construction as a compilation problem and constructs \BenchName, a ready-to-use benchmark comprising 300 certified tasks across diverse laboratory operations.
Mao-Kai Qin, Chuan Qin, Qi Zhang et al.· 0 citations
This work proposes SciHorizon-DataEVA, a novel agentic system to scalable AI-readiness evaluation of heterogeneous scientific data, based on the Sci-TQA² principles, which organize AI-readiness into four complementary dimensions: Governance Trustworthiness, Data Quality, AI Compatibility, and Scientific Adaptability.
Dian-Yu Liu, Chuan Qin, Xi Chen et al.· Proceedings of the 32nd ACM...· 0 citations
Results indicate that SciDSK improves how agents locate and understand scientific datasets, providing a stronger foundation for actionable scientific data use.
Xiao-Han Huang, Qing-Qing Long, Xiaolei Du et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.