VeriChat is presented, a domain-specialized conversational assistant designed to support, rather than replace, existing verification workflows by providing context-aware security guidance, significantly outperforming the leading proprietary models.
Abstract
Hardware security verification is a multi-stage process in which engineers must navigate complex design analyses, threat considerations, and verification strategies. They often need security-focused guidance, yet current verification environments provide little structured support for such assistance. Although conversational AI could offer such on-demand assistance, directly using general-purpose chatbots like ChatGPT or Gemini is risky due to their tendency to hallucinate and their reliance on static, outdated knowledge. We present VeriChat, a domain-specialized conversational assistant designed to support, rather than replace, existing verification workflows by providing context-aware security guidance. VeriChat employs a retrieval-augmented, multi-agent workflow in which three specialized agents collaboratively minimize hallucinations while improving the transparency and reliability of the response. Beyond question answering, VeriChat integrates open-source EDA tools, including Icarus Verilog, Yosys, and SymbiYosys, to perform syntax checking, synthesis analysis, simulation, and formal verification directly on user-provided RTL designs. Evaluated using a comprehensive methodology, VeriChat achieves a Faithfulness score of 87.73%, significantly outperforming the leading proprietary models. We demonstrate the framework through a hardware Trojan detection case study on an AES S-Box IP, where VeriChat autonomously identifies, simulates, and formally proves a covert key-leakage vulnerability through a multi-turn conversational workflow.
With the rapid development of large language models (LLMs), LLM-based agents are evolving from single-turn text generators into autonomous decision-making systems capable of task planning, tool invocation, memory retrieval, and environmental interaction. However, the openness of agent environments and the nondeterminis...
Yang Cao· 2026 IEEE 9th International...· 0 citations
Experimental results show that AMTFV outperforms the representative baselines evaluated in this study overall; under an individual model configuration, it improves average accuracy over the strongest baseline by up to 8.3 percentage points.
This paper evaluated Niyam-AI on 2,000 real-world agent scenarios from Agent-SafetyBench and compared it against three existing safety approaches: NeMo Guardrails, Meta's Llama Prompt Guard 2, and OpenAI's GPT-OSS-Safeguard.
MACGen is a multi-agent framework that integrates planning, security analysis, code synthesis and refinement to jointly optimize security and functionality and improves F&S@1 over direct prompting on CWEval and BaxBench.
Miseon Yu, Jaehoon Choi, Younghan Lee et al.· 0 citations
A proof-of-concept neuro-symbolic architecture for “certified” academic advising that shows how an LLM-based university assistant can be connected to an auditable and reproducible symbolic layer, while preserving a clear separation between linguistic interaction and formal regulatory reasoning.
Giovanni Pilato, Mustafa Sert· International Journal of Sem...· 0 citations
A reverse engineering technique is presented for extracting a behavioural model of a deployed chatbot through the automated exploration of its functionality via Large Language Models through the automated exploration of its functionality via Large Language Models.
Iván Sotillo del Horno, Alejandro del Pozzo, Esther Guerra et al.· SN Computer Science· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.