Skip to content

Enhancing Interactive Theorem Prover Error Messages with Hints

2026 · International Conference on Interactive Theorem Proving · pp. 5:1-5:19 · 0 citations · 38 references
Computer Science

TL;DR

Investigation of how adding hints to three types of scope and type checking error messages in the Agda ITP affects the new users’ debugging experience shows that correct hints can improve the success rate and time taken to fix the error, and that error messages with hints are rated significantly more helpful than those without.

View source

Similar papers

Open access Sep 2026

Goanna: a novel approach for automated type error debugging

Goanna is introduced, a novel type checker for Haskell that focuses on improving error diagnostics, and shows performance constraints when diagnosing large programs containing complex errors, but remains responsive enough to provide real-time debugging assistance for small to medium-sized programs.

Shuai Fu, Tim Dwyer, Peter James Stuckey et al. · 0 citations
Preprint Aug 2026

Beyond the Traceback: Using LLMs for Adaptive Explanations of Programming Errors

While LLM-rewritten messages significantly improved subjective evaluations, with pragmatic messages rated as clearer and less cognitively demanding, these perceived gains did not translate into statistically significant improvements in objective debugging performance.

Alexandru-Radu Moraru, Shreyan Biswas, U. Gadiraju · 0 citations
Book Open access Oct 2026

StarFuse: LLM Guided Multimodal Interactive Theorem Proving

Interactive Theorem Provers (ITPs) like F* provide robust mathematical guarantees for software correctness, but their steep learning curves, specialized syntax, and complex proof mechanics severely limit their mainstream adoption. To lower this entry barrier, we propose StarFuse, an LLM-assisted developer tool that aut...

Sharvil Athaley, Samyak Singhania, Khushboo Agrawal et al. · 0 citations
Book Open access Aug 2026

Does Great Power Come with Great Explainability? Comparing Explanation Strategies for Automated Program Diagnosis

Debugging is an important activity in software development, yet providing actionable and comprehensible explanations for program failures remains challenging. Automated tools such as ALHAZEN and AVICENNA address this by using distinct strategies: ALHAZEN employs binary decision trees to show failure-inducing conditions...

C. Lazik, Martin Eberlein, Aaron Ziglowski et al. · 0 citations
#human-computer interacti... Book Open access Aug 2026

FlowCheck: Helping End-Users Specify and Verify Intent in Vibe-Coded Web Apps

FlowCheck, a constraint language to specify user-visible information flows directly through the application interface, where constraints can also be displayed and inspected without reading code, and are structured enough for reliable LLM generation.

Reya Vir, Lydia B. Chilton, Zhuo Zhang et al. · 2 citations
Review Sep 2026

Understanding the Usability of Cryptographic Verification Tools

An exploratory human-centered study of experienced users of Tamarin, ProVerif, and related protocol verifiers reveals usability barriers across the verification workflow, including difficulties debugging non-termination and performance issues, and the lack of systematic methods for validating formal models against real...

Tarikul Islam, Y. Islam, Khandakar Ashrafi Akbar et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.