Back to #software testing

Natural-Language Workflows Are Not Software Yet: Artifact-Driven Compilation for Reliable Agent Execution

Xiangzhe Xu Hanxi Guo Guangyu Shen Siyuan Cheng Xiangyu Zhang
Aug 2026 · 0 citations · 64 references
Computer Science

TL;DR

Artic is proposed, an artifact-driven workflow compiler that transforms a natural-language workflow into an artifact-driven workflow in which each step declares the artifacts it reads and writes, constraints gate produced artifacts, and explicit control transfers route execution.

Abstract

Natural-language workflows offer a software-like interface for agents: domain experts can write reusable procedures, and agents can execute them as instructions. This promise is not yet reliable. Workflow descriptions often leave data dependencies implicit, so the executor must infer which prior results a step should use; agents can also fail to follow long or branching instructions under context pressure. We propose Artic, an artifact-driven workflow compiler that transforms a natural-language workflow into an artifact-driven workflow in which each step declares the artifacts it reads and writes, constraints gate produced artifacts, and explicit control transfers route execution. This representation exposes the enforcement burden placed on agent execution, allowing the compiler to identify steps that depend on too much state or contain difficult control logic and refine them through constrained optimization. To validate the LLM-assisted transformation, Artic decomposes faithfulness checking into local obligations and uses scenario-based dry runs to test whether compiled workflow regions conform to the source workflow. We evaluate Artic on 488 problem instances from 11 real-world domain workflows; it improves task resolve rate by 28 percentage points over the original text workflow. We also show that workflows compiled by Artic are 32 and 56 percentage points more consistent in cross-model and repeated-execution setups, respectively.

View source

Similar papers

#software testing Preprint Aug 2026

Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software Migration

The results show that specification size alone does not predict implementation quality and that cross-agent transfer can produce substantial agent-dependent degradation, and suggest that specifications in heterogeneous SDD workflows should not automatically be treated as agent-neutral artifacts.

Oleg Grynets, O. Ilchuk, Dariia Zatulna et al. · 0 citations
#software testing Review Aug 2026

ChatGPT Solves All Tested Qiskit Homework Assignments

This study examined whether introductory Qiskit homework could remain autogradable while requiring students to run, review, and discuss results rather than banning AI.

A. Kaltchenko, Gurnivaj Tiwana · 0 citations

Mixed Reality Glasses Image Translocation for Binocular Diplopia.

This prototype MRG image translocation software was helpful to 69% of patients with binocular diplopia, but limited by large angle strabismus because of the limited instrument field of view.

Edsel B Ing, Kevin Sha, Sarosh Dandoti et al. · 0 citations
#software testing Open access Aug 2026

Multi-Disease Prediction Using Machine Learning: A Web-Based Diagnostic Support System for Diabetes, Heart Disease, and Parkinson\'s Disease

A diagnostic support system based on a unified web platform that classifies patients according to the risks of developing three diseases based on regularly collected clinical or audio data using classical supervised learning algorithms is presented.

Vedamurthy D R, Dr. Anup Ritti, A. Bibi et al. · 0 citations
#software testing Review Aug 2026

The Influence of Green Procurement on Supply Chain Resilience in Nigeria Maritime University, South-South Region

A high initial investment in acquiring environmentally friendly products can discourage institutions from adopting them. This study explored the extent to which eco-friendly products contribute to supply chain resilience and operational performance at the Nigerian Maritime University. The study employed a quantitative survey method administering a sample of 303copies questionnaire to the staff of the organization using a stratified sampling technique. The hypotheses were tested and analyzed using a regression method with the aid of Minitab software. The regression analysis indicates eco-friendly products significantly relates to operational efficiency in Nigerian Maritime University, South-South Nigeria. The model regression indicates (R² = 99.20, B = 1.039, β = 0.0162, p = 0.000); indicating that the model is a good fit. The coefficient 1.0399 is highly significant (p < 0.001). This indicates a positive and strong effect, explaining that for every one-unit increase in eco-friendly products, the operational efficiency increases by approximately 1.039 units. The NOVA result confirms F = 4117.07, p < 0.001. The study concludes that the adoption of eco-friendly products plays a significant and positive role in enhancing organizational sustainability performance or resilience. Organizations should embed eco-friendly product selection into their procurement guidelines to promote sustainable operations. Management should invest in environmentally friendly technologies and capacity building initiatives to support the transition to sustainable practices.

Ikenna Christopher Ugwu · 0 citations

Related blog posts

MIT News · Artificial Intelligence Aug 17, 2026

Q&A: Rethinking how innovation happens

In his latest book, Professor Eugene Fitzgerald examines the forces that turn breakthroughs into value — and why innovation resists simple formulas.