Back to feed
Book Open access

An Empirical Evaluation of Generative AI in Security Requirements Engineering and Threat Modeling

Jul 2026 · SIGSOFT FSE Companion · 0 citations · 28 references
Computer Science

TL;DR

Empirical evidence is provided that generative AI can effectively support security requirements engineering when embedded within human-centered workflows and organizational governance structures, offering practical insights for adoption in regulated software development contexts.

Abstract

The manual generation of software development artifacts in large organizations—particularly security requirements and threat models—demands substantial effort and is prone to inconsistencies and coverage gaps. While recent advances in generative AI show promise for supporting Requirements Engineering, their adoption in security-critical and regulated environments remains limited due to concerns related to trust, data privacy, and domain specificity. This paper presents an empirical evaluation of an LLM-based AI assistant designed to support security requirements engineering and threat modeling under controlled and auditable conditions. The proposed approach adopts a human-AI hybrid workflow, in which AI-generated artifacts are systematically reviewed and validated by specialists to preserve contextual accuracy and regulatory compliance. Using business documents as input, the assistant generates candidate security requirements and STRIDE-based threat models. The study compares AI-only, manual, and hybrid workflows across 20 real-world projects conducted in a Brazilian public organization. Results show an average reduction of 18.3% in artifact generation time and a 13.6% increase in STRIDE threat coverage, while maintaining 73% semantic precision. Furthermore, the hybrid human-AI approach consistently outperformed the fully manual process in terms of completeness and overall quality. These findings provide empirical evidence that generative AI can effectively support security requirements engineering when embedded within human-centered workflows and organizational governance structures, offering practical insights for adoption in regulated software development contexts.

Read PDF

Similar papers

Book Open access Jul 2026

MAS-SRE: A Multi-Agent System for Security Requirements Engineering

Translating high-level business requirements into standards-grounded security requirements remains a persistent challenge in software engineering. Traditional Security Requirements Engineering (SRE) is often manual, error-prone, and too slow for modern development, creating a translation gap that can leave software vulnerable. This paper presents MAS-SRE, a multi-agent framework that automates the transformation of business requirements into traceable security requirements grounded in OWASP ASVS, NIST SP 800–53, and ISO 27001. MAS-SRE orchestrates 10 specialized agents across 4 workflow stages and combines STRIDE-based threat modeling with Retrieval-Augmented Generation (RAG) to produce standards-aligned outputs. Following the Design Science Research Process, the framework was evaluated on 14 industrial use cases through expert assessment by 15 software engineering practitioners and deterministic coverage and traceability metrics. MAS-SRE achieved 100% verification test coverage, 98.6% threat mapping coverage, 87.6% control mapping coverage, and about 40% lower processing time than sequential execution, while also receiving positive practitioner feedback on usefulness and adoption intent. These results indicate that MAS-SRE is a feasible approach for drafting standards-grounded, traceable security requirements, although comparative evaluation against alternative methods and deeper integration into development workflows remain future work.

Savvas Mantzouranidis, Ricardo Britto · 0 citations
#artificial intelligence Preprint Jul 2026

From Adoption to Deployment: A Qualitative Study on AI Integration in Software Development Practice

The goal of this study is to understand practitioners'decision making process and security considerations in selecting and integrating AI components through an exploratory semi-structured interview study, and distill the findings into actionable recommendations for AI adopters, model providers, and researchers.

Mahzabin Tamanna, Elizabeth Lin, Sparsha Gowda et al. · 0 citations
Review Jul 2026

Emerging Challenges in Threat Modeling for GenAI-Augmented Systems: A View from the Trenches

Threat modeling remains a central task in secure software engineering, as it enables the identification of security issues from system architectures. As Generative Artificial Intelligence (GenAI) becomes increasingly pervasive across software systems, traditional threat modeling methods (e.g., STRIDE) are insufficient to assess emerging GenAI-specific risks. In this work, we present the first results from an exploratory assessment of GenAI-aware threat modeling methods in a Small and Medium Enterprise (SME) setting. For this, we conducted a rapid literature review to select relevant techniques and systematically applied three shortlisted methods to an industrial case study involving a GenAI-augmented system. The results highlight differences in the threats identified by each technique and reveal limited support for certain GenAI-specific risk categories, particularly those related to software supply chains and human-centered security issues. We further report practitioners'perceptions of the usability and integration of these methods in SME development workflows, including their perceived effort and adoption challenges.

Nicolás E. Díaz Ferreyra, M. Kumar, Nohemí Villarreal et al. · 0 citations
Conference Jun 2026

A Multimodal Large Language Model Approach for Automated Security Requirements Verification

Traditional security auditing and compliance are resource-intensive manual processes. Recent work has applied Large Language Models to automate compliance tasks, but these approaches typically rely on textual inputs, limiting their applicability to real-world audit artifacts. This study proposes a Multimodal Large Language Model (MLLM)-based system for security requirements verification using evidence-grounded analysis of multimodal audit artifacts. The model is constrained to only consider artifacts provided at inference time. Evaluation is conducted through an industrial case study using real audit data, including artifacts, requirements, and ground truth labels. Results show good accuracy and explainability (up to 77%), high consistency, and high recall but lower precision. These findings demonstrate the potential of MLLMs to support automated security requirements verification in practical audit settings.

Ismail Esack Dawoodjee, A. Khurat, Thanapon Noraset · 0 citations
Review Open access 2026

Accelerating Safety-Critical Automotive Software Development Through Reproducible AI-Assisted Requirements Engineering

Automotive software developed under ISO 26262 and ISO/SAE 21434 depends on requirements that are traceable, reviewable, and grounded in safety and cybersecurity evidence. The practical bottleneck is often not requirement writing alone, but turning fragmented project artifacts into auditable specifications at engineering speed. This paper presents CADRE, an AI-assisted requirements-engineering framework for safety- and cybersecurity-critical automotive systems. CADRE combines deterministic parsers for structured artifacts with retrieval-augmented synthesis for semi-structured and unstructured sources. It constrains this workflow through schema validation, source-grounded traceability, expert review gates, fixed decoding controls, and cryptographic provenance tracking. The evaluation covers four industrial automotive modules from ASIL-B to ASIL-D and CAL-2 to CAL-4. CADRE produced 1,022 synthesized requirements, achieved 98.6% traceability coverage, kept the fabrication rate at 0.2%, and produced byte-identical outputs across independent runs. The results indicate that language-model assistance can add value in regulated automotive requirements workflows when it is embedded in deterministic, provenance-rich, and expert-governed processes.

Alexander Lomovtsev · 1 citation