Back to #software testing

BreakGuard: Towards Detecting Dependency Breaking Changes with LLM-Generated Tests

Aug 2026 · 0 citations · 45 references
Computer Science

TL;DR

This work proposes BreakGuard, an approach that generates a test suite to detect breaking changes in clients and successfully detected BCs from different library categories, but finds LLM-generated tests to be more reliable for detecting crash-type breaking changes as opposed to behavioural BCs.

Abstract

Open-source libraries play an important role in software development by providing reusable features that expedite the development process. As libraries evolve, they release new versions that add features, fix bugs, or apply security patches. In this process, they may break the contract established with their clients by introducing breaking changes (BCs) that alter the runtime behavior and break client applications. Client-side test suites often fail to detect these BCs because of limited library coverage that does not exercise all library methods used in the client's codebase. We propose BreakGuard, an approach that generates a test suite to detect breaking changes in clients. BreakGuard statically extracts every client method (focal method) that invokes the target library method (call site), then generates tests per focal method. A test detects a BC if it passes on the pre-breaking version and fails on the breaking version. We evaluate our approach on 89 real-world breaking changes from the BUMP dataset, using 3 LLMs (GPT4o, Qwen3-coder-480B, GPT-OSS-120B) and three context levels: minimal, method, and class. Using the best-performing configuration, BreakGuard detects 30.3% of breaking changes (27 of 89) at a mean cost of roughly $0.90 USD per detected breaking change. We successfully detected BCs from different library categories (e.g., JSON libraries, logging, parsing), but we find LLM-generated tests to be more reliable for detecting crash-type breaking changes as opposed to behavioural BCs.

View source

Similar papers

#software testing Open access Aug 2026

IMPACT OF PROXIMAL RELATIONSHIPS ON DRUG USE: A STUDY IN THERAPEUTIC COMMUNITIES

Drug use is an ancient practice, but its associated disorders represent a contemporary public health challenge. This study investigates the impact of proximal processes in childhood/adolescence and adulthood on substance use, focusing on the role of Therapeutic Communities (TCs). Using a qualitative methodology, 19 residents of TCs in the state of Rio de Janeiro were interviewed. Instruments included a screening test (ASSIST), a sociodemographic inventory, and semi-structured interviews. Content analysis of the interviews was supported by the Requalify.ai software, which proved to be an efficient tool for categorizing and visualizing qualitative data. Results indicate that factors such as dysfunctional family environments, violence, and early onset of consumption, often mediated by peer influence, are determining risk factors. On the other hand, peer social support within TCs emerges as a crucial protective factor, associated with positive changes reported by participants. The sample revealed an overrepresentation of Black and Brown individuals, highlighting the racial dimension in the history of drug use in Brazil. The study concludes that proximal relationships are decisive in both the etiology and recovery of substance use disorders, and that TCs, although controversial, can offer a supportive environment that favors change, especially through peer support and cohabitation.

Marceli de Souza Rosa-Pereira, L. Pessoa · 0 citations

Reverse Engineering of Chatbot Behaviour for Automated Testing

A reverse engineering technique is presented for extracting a behavioural model of a deployed chatbot through the automated exploration of its functionality via Large Language Models through the automated exploration of its functionality via Large Language Models.

Iván Sotillo del Horno, Alejandro del Pozzo, Esther Guerra et al. · 0 citations

Mixed Reality Glasses Image Translocation for Binocular Diplopia.

This prototype MRG image translocation software was helpful to 69% of patients with binocular diplopia, but limited by large angle strabismus because of the limited instrument field of view.

Edsel B Ing, Kevin Sha, Sarosh Dandoti et al. · 0 citations
#software testing Open access Aug 2026

Multi-Disease Prediction Using Machine Learning: A Web-Based Diagnostic Support System for Diabetes, Heart Disease, and Parkinson\'s Disease

A diagnostic support system based on a unified web platform that classifies patients according to the risks of developing three diseases based on regularly collected clinical or audio data using classical supervised learning algorithms is presented.

Vedamurthy D R, Dr. Anup Ritti, A. Bibi et al. · 0 citations
#software testing Open access Aug 2026

UNMANNED AIRCRAFT SYSTEMS IN CRITICAL INFRASTRUCTURE INSPECTION: A FIELD STUDY OF TELECOMMUNICATIONS BASE-STATION TOWERS

Telecommunications base-station towers support services that are indispensable to crisis communication, emergency response, public administration and economic continuity. Their dispersed location, height and lattice geometry make conventional close-access inspection hazardous, time-consuming and difficult to document consistently. This study evaluates the usefulness and limitations of uncrewed aircraft systems for inspecting steel lattice towers that form part of telecommunications critical infrastructure. A retrospective field study was conducted using records from inspections performed in 2022–2023 at 50 towers in three Polish provinces. More than 150 sorties were completed with a DJI Matrice 30T platform using optical zoom, thermal imaging, a laser rangefinder and georeferenced mission telemetry. Manual, column and spiral flight patterns were compared, while image sets were processed with photogrammetric software to support three-dimensional reconstruction and spatial localisation of defects. The observations show that uncrewed inspection is particularly effective for documenting coating damage, local corrosion, fastener deterioration, connection anomalies, snow or ice accretion and equipment requiring thermographic follow-up. Column flights generated the most detailed evidence but also the greatest processing burden; spiral flights were faster and better suited to screening and three-dimensional modelling. The study also identified important constraints: wind, battery endurance, vegetation, airspace restrictions, electromagnetic and navigation disturbances, and the need to protect sensitive infrastructure data. Uncrewed aircraft should therefore be treated as a risk-based screening and documentation tool integrated with engineering judgement and targeted close-contact or non-destructive testing, rather than as an unconditional replacement for statutory structural inspection.

Rafał Parczewski, Tomasz Balcerzak, S. Żurawski · 0 citations

Related blog posts

MIT News · Artificial Intelligence Aug 17, 2026

Q&A: Rethinking how innovation happens

In his latest book, Professor Eugene Fitzgerald examines the forces that turn breakthroughs into value — and why innovation resists simple formulas.