Coupling large language models with domain-specific small models: toward efficient extraction, management and validation of 2D materials literature data.
Two-dimensional (2D) materials exhibit distinctive physical, chemical, and electronic-structure properties that make them highly attractive for energy storage and conversion applications. However, the synthesis routes, performance metrics, and article-level metadata are scattered across different literature studies, which are difficult to standardize and reuse systematically. To this end, we have developed an end-to-end framework for literature knowledge extraction, data management and data mining. Based on large language models (LLMs), the framework is enhanced by domain-informed context engineering and lightweight fine-tuning. It has successfully extracted the structured information from approximately 50 000 research papers and integrated the extracted data into a relational knowledge base that contains 600 200 performance records and 202 300 synthesis records. The constructed knowledge database is supported by our proposed multi-agent SQL workflow for natural-language retrieval. To further assess the utility of the extracted knowledge, we have incorporated the band-gap records in the literature into the C2DB-based band-gap prediction benchmark to conduct the external evaluation by using five-fold cross-validation. The inclusion of the extracted records yielded stable mean R2 and pooled MAE. Further SHAP analysis indicates that the model predictions are mainly driven by physically meaningful descriptors related to thermodynamic stability, elemental periodicity, local coordination environments, and learned CHGNet representations. The results show that the LLM-extracted literature data are not only the searchable text resources, but also can be incorporated into quantitative modeling and interpretability analysis, thereby facilitating data-driven materials discovery, performance optimization, and mechanistic understanding.
Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...
O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al.· Zenodo (CERN European Organi...· 465 citations
The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.
Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al.· IEEE Transactions on Softwar...· 178 citations· ⚡14
Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.
M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al.· e-Informatica Software Engin...· 157 citations· ⚡17
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al.· Empirical Software Engineeri...· 127 citations· ⚡15
The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.
Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al.· Journal of Systems and Softw...· 111 citations· ⚡8
This study investigates how Lean internal startup facilitates software product innovation in large companies and identifies its enablers and inhibitors, and shows the potential of the method-in-action framework to investigate the Lean startup approach in non-startup context.
Henry Edison, Nina M. Smørsgård, Xiaofeng Wang et al.· Journal of Systems and Softw...· 78 citations· ⚡6