Oct 2026· Zenodo (CERN European Organization for Nuclear Research)
Abstract
Abstract Large language models generate text token by token, without committing in advance to what a complete answer must contain. This makes them fluent but structurally unreliable: required elements may be omitted, constraints may be ignored, and unsupported claims may appear with unwarranted confidence. Retrieval and chain-of-thought intervene only after generation has already begun; fine-tuning changes the model rather than the prompt. This work evaluates D/E/S, a prompt-level protocol that specifies the components of an answer, their dependency structure, and the epistemic markers for unsupported claims before any text is produced. The study spans six models from four organisations, seven prompt conditions, and 52 tasks across three regimes — framework content, domain-independent reasoning, and adversarial information gaps. Execution quality is assessed through dual LLM-as-judge scoring, inter-judge disagreement analysis, and a five-condition ablation against two published alternatives. The scope of D/E/S is prompt-level discipline: qualifying claims, exposing missing evidence, and enforcing structural completeness. The study maps where such a protocol helps, where it is neutral, and where it fails, providing a boundary-level understanding rather than a mechanism-level claim. Three results. The protocol is followed reliably by the two largest models and unreliably below that tier, and the drop depends on how the structure is encoded rather than on the structure itself. Which encoding works best differs from model to model, and a poor choice performs worse than no protocol at all. Against two published alternatives the protocol improves hallucination suppression consistently across the large models tested; against chain-of-thought the outcome depends on the model. Keywords: large language models, hallucination suppression, prompt architecture, structured generation, D/E/S framework, LLM-as-judge, benchmark evaluation, epistemic calibrationData and full directory structure: https://github.com/gavingu2255-ai/wlm-des-benchmark
The results are packaged in the Greenfield Startup Model (GSM), which explains the priority of startups to release the product as quickly as possible, and the need to shorten time-to-market, by speeding up the development through low-precision engineering activities.
Carmine Giardino, Nicolò Paternoster, M. Unterkalmsteiner et al.· IEEE Transactions on Softwar...· 178 citations· ⚡14
Software startup companies develop innovative, software-intensive products within limited timeframes and with few resources, searching for sustainable and scalable business models.
M. Unterkalmsteiner, P. Abrahamsson, Xiaofeng Wang et al.· e-Informatica Software Engin...· 157 citations· ⚡17
This study conducts a case survey study based on the secondary data of the major pivots happened in 49 software startups, and demonstrates that customer need pivot is the most common among all pivot types.
Sohaib Shahid Bajwa, Xiaofeng Wang, Anh Nguyen-Duc et al.· Empirical Software Engineeri...· 127 citations· ⚡15
The comparison of adopter and non-adopter sample reveals three potential adoption inhibitor, security, data privacy, and portability, which underlines the importance of the technical and security perspectives for research investigating the adoption of technology.
Nattakarn Phaphoom, Xiaofeng Wang, S. Samuel et al.· Journal of Systems and Softw...· 111 citations· ⚡8
The ongoing work building a Raspberry Pi cluster consisting of 300 nodes is presented, with potential use cases being an inexpensive and green test bed for cloud computing research and a robust and mobile data center for operating in adverse environments.
P. Abrahamsson, S. Helmer, Nattakarn Phaphoom et al.· IEEE International Conferenc...· 110 citations· ⚡7
The findings show that speed related agile practices are used to a greater extent in comparison to quality practices, and that software startups who adopt the Lean Startup approach do not sacrifice quality for speed more than other startups do.
Jevgenija Pantiuchina, Marco Mondini, Dron Khanna et al.· International Conference on...· 84 citations· ⚡4
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026
Able to defeat top-ranked human players and more efficient than other models, the new system could help decision-makers in military maneuvers or business negotiations.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.