Skip to content
#software testing Review Open access

A Review of Research on the Development of Artificial Intelligence Programming Agent-Assisted Software

Sep 2026 · Computers and artificial intelligence · 0 citations · 59 references

TL;DR

This paper adopts a structured narrative review method to review the research progress from the aspects of code-based models, agent control mechanisms, repository-level systems, evaluation benchmarks, and human-computer collaboration evidence, and compares the research scope and analysis focus with existing reviews on software engineering agents.

Abstract

The development of large language models has enabled AI-assisted programming to gradually expand from early code completion to requirements understanding, code generation, testing, debugging, and project maintenance. The programming intelligence agent formed on this basis is no longer just returning a piece of code based on user input, but can read project files, break down tasks, call terminals and testing tools, and repeatedly modify the program based on the running results. Based on 60 publicly searchable representative papers, this paper adopts a structured narrative review method to review the research progress from the aspects of code-based models, agent control mechanisms, repository-level systems, evaluation benchmarks, and human-computer collaboration evidence. It also compares the research scope and analysis focus with existing reviews on software engineering agents. This paper further utilizes method classification, performance statistics, and mechanism diagrams to analyze different technical approaches, focusing on issues such as reliability, contextual understanding in large-scale projects, security and privacy, evaluation and reproducibility, operating costs, and accountability and governance. Research shows that programming agents can reduce the cost of repetitive coding and help users lacking professional programming experience complete prototype development. However, its efficiency gains are significantly affected by task size, project familiarity, quality standards, and manual review costs, making it difficult to consistently understand requirements and guarantee overall quality in complex projects. Future research should shift from simply pursuing the quantity of code generated to building verifiable, explainable, traceable, and collaborative software development processes.

Read PDF

Similar papers

Review Aug 2026

Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report

A comprehensive overview of the existing tools and frameworks for implementing MAS in software engineering and a set of lessons learned and challenges that can help researchers and practitioners to select a suitable MAS framework according to their needs are provided.

Maria Sâmyla Serafim de Oliveira, M. Ibiyo, Marco Gianrusso et al. · 1 citation
Conference Open access Sep 2026

From Typist to Collaborator: A Systematic Review of AI’s Impact on Programming Efficiency and the Shift in Developer Roles

With continuous advancements in AI and large language models, AI in programming has evolved from simple code completion to intelligent agents with contextual understanding. This change has not only had a significant impact on the field of programming but also on programmers' employment. This paper aims to explore new w...

Zi-Yu Wang · 0 citations
Review Open access Aug 2026

AgentCodeReview: Implementation and Comprehensive Benchmark Evaluation of a Multi-Agent Framework for Explainable Code Review and Automated Bug Repair

The AgentCodeReview system is presented, a multi-agent system that is able to conduct explainable code review and automated bug repair by leveraging software engineering agents with different code review tasks and its utility and extensibility to the field of explainable AI in software quality assurance are demonstrate...

B. N, T. Manasa · 0 citations
Review Sep 2026

Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skills

A structured scoping survey organized around the question of what decision a test changes is presented, and distinguishes the Red--Green--Refactor cycle from test-conditioned generation, execution-guided refinement, test-mediated analysis, and evaluation-only testing.

Yun-Hao Liang, Cheng-Guang Gan, Rui-Xuan Ying et al. · 0 citations
Open access 2026

Switching Perspectives in the Era of Artificial Intelligence-Assisted Software Development

Initial evidence of the existence and variation of Perspective Switching is provided and its importance in the context of AI-assisted software development, where the human role shifts from code production to critical evaluation and validation, is discussed.

Muhammad Asri bin Muhamad Khidzi, Muhammad Faiz bin Supian, Abdul Azim bin Abdul Rashid et al. · 0 citations
Review Sep 2026

Research with AI Agents: How Agentic Systems Are Changing Scientific Work

Background. Agentic AI systems independently decompose tasks such as literature search, data analysis, and programming into subtasks, search the web, access databases, and execute code. This allows them to perform digital research tasks at high speed. Objectives. Under what conditions does the use of agentic systems pr...

Johannes B. Lötz, M. Wenzel · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 2, 2026

Documenting the tech worker movement

Writing as a participant and researcher, PhD student JS Tan SM ’22 has co-authored a new book about the rise of tech worker protests and the employer backlash that followed.

GPT-Lab Sep 23, 2026

Requirements Don’t Live in Isolation: What We’re Exploring with Req-Space

Requirements in large systems rarely exist in isolation. Their meaning depends on the wider project context - other requirements, policies, decisions, tests, and implementation details. That becomes especially important when AI is used for review, because spotting a possible conflict or gap is only the beginning. ReqSpace explores how AI, visualisation, and connected project context can help reviewers understand those findings, trace the relationships behind them, and focus on the questions that…

GPT-Lab Sep 17, 2026

Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering

AI is making software generation faster, but speed does not remove the need for expertise. As more work is delegated to AI, tacit knowledge may become one of the most important human advantages in software engineering. The post Beyond Prompt Engineering: The Role of Tacit Knowledge in Software Engineering appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.