Skip to content

LLM-based agents for automating the enhancement of user story quality: An early report

Mar 2024 · International Conference on Agile Software Development · pp. 117-126 · 48 citations · ⚡ 4 influential · 26 references
Computer Science

TL;DR

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Abstract

In agile software development, maintaining high-quality user stories is crucial, but also challenging. This study explores the use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams. We developed a reference model for an Autonomous LLM-based Agent System and implemented it at the company. The quality of user stories in the study and the effectiveness of these agents for user story quality improvement was assessed by 11 participants across six agile teams. Our findings demonstrate the potential of LLMs in improving user story quality, contributing to the research on AI role in agile development, and providing a practical example of the transformative impact of AI in an industry setting.

Read PDF

Similar papers

Jul 2026

SoftBoard: A Multi-Agent Tool for the Creation and Evaluation of Low-Fidelity Prototypes

User Experience (UX) is recognized as a critical factor for the success of digital products, particularly in software startups, environments marked by time constraints, limited resources, and low maturity in design practices. Building Minimum Viable Products (MVPs) through low-fidelity prototyping represents a well-established strategy for rapid validation cycles at reduced cost. A systematic literature mapping, however, revealed gaps in the ecosystem of available tools: a predominance of general-purpose solutions adapted for prototyping, the absence of integrated methodological guidance, and the incipient use of Artificial Intelligence in the design process. This paper presents SoftBoard, a web-based tool for the creation and evaluation of low-fidelity prototypes in the context of MVP development. The tool integrates a prototype editor, team-based project organization, and a multi-agent system based on large language models that supports requirements elicitation and refinement, automates prototype generation, and evaluates interface quality based on usability heuristics. This integration aims to reduce reliance on prior UX expertise, standardize the prototyping process, and support teams in building MVPs aligned with user needs. As future work, a feasibility study with software professionals is currently underway.

Gabriel Scapim, G. Leal, G. Guerino · 0 citations
Open access Jul 2026

The Use of Generative AI Tools by Requirements Engineers: An Interview with Industry Professionals

This paper investigates how Generative Artificial Intelligence (GenAI) grounded in Large Language Models (LLMs) are being employed to support activities within Requirements Engineering (RE). Based on interviews conducted with software engineering professionals, the findings indicate that GenAI tools are particularly valuable during requirements elicitation and specification, contributing to improved productivity and reduced operational effort, especially when addressing Functional Requirements (FRs). Despite these benefits, participants also reported important limitations, including sensitivity to prompt formulation, generation of overly generic outputs, and limited capability to adequately support Non-Functional Requirements (NFRs).

J. V. Ferreira, C. Portela, S. Oliveira · 0 citations
Book Open access Aug 2026

Unpacking Human–GenAI Collaboration in Software Engineering Education

Generative AI tools such as ChatGPT, Claude, and Gemini are increasingly shaping how students engage with software engineering (SE) problem-solving. However, there is limited understanding of how learners collaborate with GenAI across different stages of the software development lifecycle (SDLC), and how learner agency shifts during this process. This research unpacks the problem-solving strategies, collaboration patterns, and agency shifts underlying human–GenAI collaboration in software engineering education. Using a mixed-methods approach, it draws on multimodal data including screen recordings, GenAI transcripts, task artefacts, and retrospective think-aloud interviews. Preliminary findings suggest that learners engage with GenAI differently across SDLC phases, with variation in reliance, evaluation, and decision-making. Future work will extend this analysis to larger and more diverse learner groups and inform pedagogical supports for effective, critical, and agentic GenAI-supported problem-solving.

Sonika Pal · 0 citations
Review Open access Sep 2026

GAMIFICATION FOR THE IMPLEMENTATION OF A SYSTEMS INTEGRATION PROJECT

This article analyzes the application of gamification strategies as a tool to optimize Information Technology (IT) project management within the agribusiness sector, specifically in contexts that combine predictive and agile approaches. The study is based on a literature review that establishes the theoretical framework for a future operational systems integration project. The proposal explores how the introduction of game-like elements—such as badge systems, avatars, visual goal tracking, and rewards for completed milestones—can boost team engagement and motivation. Additionally, the article addresses the use of generative Artificial Intelligence tools to develop the project's visual identity, enabling the creation of unique, customized graphic assets. In practical terms, the work outlines guidelines for a future implementation focused on automating data flow via standardized communication protocols, aiming to eliminate manual processes, mitigate human error, and establish continuous feedback mechanisms.

Unknown authors · 0 citations

Related blog posts

MIT News · Artificial Intelligence Jun 3, 2026

MIT researchers teach AI models to interpret charts

The new ChartNet training dataset could improve the accuracy of vision-language models that help analyze business trends or interpret scientific figures.

Microsoft Research Blog Jul 30, 2026

Echoverse: Deep, evolving environments for computer-use agents

Computer-use AI agents struggle with multi-step workflows like email and customer support. Echoverse trains agents in realistic environments rather than simply providing more training tasks, helping them improve as the tasks, tests, and environments evolve. The post Echoverse: Deep, evolving environments for computer-use agents appeared first on Microsoft Research.

MIT News · Artificial Intelligence Jul 14, 2026

Helping AI models to meet the real world

Through research and entrepreneurship, Professor Devavrat Shah is helping to design methods that can handle constant decision-making using limited computational resources.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.