BioDataLab evaluates the capability of autonomous agents to transform raw, heterogeneous biological resources into structured, analysis-ready databases, and underscores that while LLMs are proficient in downstream reasoning, autonomous upstream curation remains a formidable frontier.
Jiaxian Yan, Xi Fang, Jintao Zhu et al.· Proceedings of the 32nd ACM...· 0 citations
This work proposes LumiCharge, a novel atomic charge prediction framework that incorporates high-order spherical harmonics convolutions and explicitly models multibody interactions, and demonstrates exceptional extrapolation capability and robustness across molecules of varying sizes, effectively overcoming the limitations imposed by molecular sizes.
Qun Su, Hui Zhang, Qiaolin Gou et al.· Journal of Physical Chemistr...· 2 citations
This work introduces an advanced equivariant graph attention neural network specifically engineered to model long-range atomic electrostatic interactions with high precision, and improves the model's accuracy, generalization, and robustness in complex scenarios.
Qiaolin Gou, Qun Su, Ji-Ke Wang et al.· Journal of Chemical Informat...· 1 citation
Token-Mol is presented, a token-only 3D drug design model that encodes both 2D and 3D structural information, along with molecular properties, into discrete tokens, which introduces a Gaussian cross-entropy loss function tailored for regression tasks, enabling superior performance across multiple downstream applications.
Ji-Ke Wang, Rui Qin, Mingyang Wang et al.· Nature Communications· 30 citations· ⚡1
High-quality biological databases are the bedrock of data-driven scientific discovery. However, the construction of these resources remains a labor-intensive bottleneck, particularly for emerging research frontiers where structured data is non-existent. While LLM-based agents have catalyzed progress in downstream scientific modeling, their potential to automate the critical upstream challenge of database curation remains largely untapped. To bridge this gap, we introduce BioDataLab, a rigorous benchmark comprising 100 tasks meticulously derived from 57 high-impact database publications. BioDataLab evaluates the capability of autonomous agents to transform raw, heterogeneous biological resources into structured, analysis-ready databases. Unlike static evaluations, BioDataLab provides a fully interactive environment encompassing data retrieval, extraction, annotation, and integration, featuring process-oriented curation targets and contamination-control checks. We benchmark 11 state-of-the-art LLMs (including Gemini-3.0, GPT-5.2, and Claude-4.5) under different agent frameworks, revealing a substantial capability gap: the top-performing model achieves only a 40% success rate. Further error analysis identifies significant bottlenecks in multi-step tool orchestration and adherence to complex biological data formats. These findings underscore that while LLMs are proficient in downstream reasoning, autonomous upstream curation remains a formidable frontier. All data and codes are available at GitHub.
Jiaxian Yan, Xi Fang, Jintao Zhu et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
