Back to #software testing

Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software Migration

Aug 2026 · 0 citations · 27 references
Computer Science

TL;DR

The results show that specification size alone does not predict implementation quality and that cross-agent transfer can produce substantial agent-dependent degradation, and suggest that specifications in heterogeneous SDD workflows should not automatically be treated as agent-neutral artifacts.

Abstract

This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The study combines two experimental stages. First, a specification-first migration pipeline was evaluated on 1,006 PL/SQL files, of which 623 were successfully regenerated and 380 generated scripts executed successfully in PostgreSQL 16. Second, cross-agent experiments were conducted on a dataset of 1,802 Oracle scripts with corresponding PostgreSQL implementations using Amazon Kiro, Google Gemini, and GitHub Copilot, with Claude Code and Cursor included in the initial single-agent evaluation. Native and foreign specifications were assessed using Token F1, exact match, SQL syntax validity, AST exact match, AST mean similarity, and immediate runnability. The results show that specification size alone does not predict implementation quality and that cross-agent transfer can produce substantial agent-dependent degradation. The strongest replicated case occurred when Gemini directly consumed a Kiro-origin specification, producing a Token F1 of 0.035, SQL syntax validity of 2.33%, and AST mean similarity of 0.015. Rewriting substantially improved Gemini in the tested configuration, compression did not provide a universal benefit, and retrieval-augmented ingestion was the only common strategy represented on the per-agent Pareto frontiers of both Gemini and Copilot. The findings suggest that specifications in heterogeneous SDD workflows should not automatically be treated as agent-neutral artifacts and motivate explicit consideration of specification portability, agent-specific interpretation, and retrieval-based access in multi-agent software engineering.

View source

Similar papers

#software testing Preprint Aug 2026

Natural-Language Workflows Are Not Software Yet: Artifact-Driven Compilation for Reliable Agent Execution

Artic is proposed, an artifact-driven workflow compiler that transforms a natural-language workflow into an artifact-driven workflow in which each step declares the artifacts it reads and writes, constraints gate produced artifacts, and explicit control transfers route execution.

Xiangzhe Xu, Hanxi Guo, Guangyu Shen et al. · 0 citations
#software testing Review Aug 2026

ChatGPT Solves All Tested Qiskit Homework Assignments

This study examined whether introductory Qiskit homework could remain autogradable while requiring students to run, review, and discuss results rather than banning AI.

A. Kaltchenko, Gurnivaj Tiwana · 0 citations

Mixed Reality Glasses Image Translocation for Binocular Diplopia.

This prototype MRG image translocation software was helpful to 69% of patients with binocular diplopia, but limited by large angle strabismus because of the limited instrument field of view.

Edsel B Ing, Kevin Sha, Sarosh Dandoti et al. · 0 citations
#software testing Open access Aug 2026

Multi-Disease Prediction Using Machine Learning: A Web-Based Diagnostic Support System for Diabetes, Heart Disease, and Parkinson\'s Disease

A diagnostic support system based on a unified web platform that classifies patients according to the risks of developing three diseases based on regularly collected clinical or audio data using classical supervised learning algorithms is presented.

Vedamurthy D R, Dr. Anup Ritti, A. Bibi et al. · 0 citations
#software testing Review Aug 2026

The Influence of Green Procurement on Supply Chain Resilience in Nigeria Maritime University, South-South Region

A high initial investment in acquiring environmentally friendly products can discourage institutions from adopting them. This study explored the extent to which eco-friendly products contribute to supply chain resilience and operational performance at the Nigerian Maritime University. The study employed a quantitative survey method administering a sample of 303copies questionnaire to the staff of the organization using a stratified sampling technique. The hypotheses were tested and analyzed using a regression method with the aid of Minitab software. The regression analysis indicates eco-friendly products significantly relates to operational efficiency in Nigerian Maritime University, South-South Nigeria. The model regression indicates (R² = 99.20, B = 1.039, β = 0.0162, p = 0.000); indicating that the model is a good fit. The coefficient 1.0399 is highly significant (p < 0.001). This indicates a positive and strong effect, explaining that for every one-unit increase in eco-friendly products, the operational efficiency increases by approximately 1.039 units. The NOVA result confirms F = 4117.07, p < 0.001. The study concludes that the adoption of eco-friendly products plays a significant and positive role in enhancing organizational sustainability performance or resilience. Organizations should embed eco-friendly product selection into their procurement guidelines to promote sustainable operations. Management should invest in environmentally friendly technologies and capacity building initiatives to support the transition to sustainable practices.

Ikenna Christopher Ugwu · 0 citations

Related blog posts

MIT News · Artificial Intelligence Aug 17, 2026

Q&A: Rethinking how innovation happens

In his latest book, Professor Eugene Fitzgerald examines the forces that turn breakthroughs into value — and why innovation resists simple formulas.