Eiffel-tools, a language server protocol (LSP) implementation for the Eiffel programming language that uses Large Language Models (LLMs) to aid the development of statically verified software, is introduced.
Abstract
This article introduces Eiffel-tools, a language server protocol (LSP) implementation for the Eiffel programming language that uses Large Language Models (LLMs) to aid the development of statically verified software. The tool provides various interactive and non-interactive commands to produce code and specifications. It uses language and project specific knowledge to precisely direct the LLM and verifies the output using a static verifier. It crafts rich programmatic prompts for the input and corrects or rejects the output. Furthermore, it handles the retries until the program passes verification. The tool's bug fixing capability is evaluated on 2 public datasets using 3 models. The tool can fix 76% to 95% of bugs by combining LLMs and a formal verifier depending on the model and prompts used. The results show the trade-off between the number of fixing attempts and the success rate.
Experimental evaluation shows that increasing the proportion of successful verifications requires additional model training, a broader context, and the integration of mutation and candidate selection operations, while practical limitations of the proposed hybrid approach when using small-class models are identified.
P. Mel'nikov, Andrey Tyugashev· Reliability and Quality of C...· 0 citations
Large Language Models (LLMs) have transformed software engineering through automated code generation, yet their performance varies widely across target languages, specifically between mainstream (e.g., Python) and niche languages (e.g., OCL). Key challenges are determining which LLMs and prompting techniques can most e...
David Delgado· Proceedings of the ACM/IEEE...· 0 citations
Domain-specific languages bring domain experts into model-based engineering by allowing them to use their usual notation and terminology. However, developing a high-quality language with tooling often requires substantial implementation effort. Eclipse Langium is a TypeScript-based language workbench that addresses thi...
J. Meier, Steven Smyth, Benjamin Friedman Wilson et al.· Proceedings of the ACM/IEEE...· 0 citations
Syntax errors come up a lot when someone is trying to compile code. The messages a compiler or interpreter shows are one way the system tells the user what went wrong. These warnings and errors are part of how syntax analysis is reported back to the programmer. This work compares how three tools report syntax errors. T...
Pinky E. Erandio, Reagan Ricafort· International journal of re...· 0 citations
Program migration, which involves translating software systems from one programming language to another, is essential for modernizing legacy systems and improving maintainability. Recent large language models (LLMs) have demonstrated strong performance in code translation; however, existing methods and benchmarks still...
Xi-Tao Li, Xiao-Fei Xie, Jiang Wu et al.· Proceedings of the ACM on Pr...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
