Jul 2026· Annual International Computer Software and Applications Conference· pp. 1763-1764· 0 citations· 9 references
Computer Science
Abstract
Graphical user interface (GUI) tests are used to validate end-to-end business flows. In microservice-based systems, a single user action may trigger a chain of inter-service calls, which require verification. In practice, end-to-end test suite design is largely manual and hard to maintain. We propose a multi-agent workflow that takes as input use cases, microservice interface specification, architecture documentation, and a GUI description, and produces executable Selenium tests with test oracles. We evaluate the approach on open-source microservice systems by comparing the generated suites with manually created benchmarks. During test execution, we collect execution traces to evaluate the coverage of microservice endpoints. In addition, we evaluate the fault detection capability of the generated test suites by seeding faults into the systems under test.
The experimental results show that the Cypress-based end-to-end test suite has short and stable execution times, and resilient data-cy attributes significantly reduce maintenance overhead when UI changes occur.
Quoc-Binh Nguyen, Truc-Ly Phan Nguyen, Ngoc Hong Tran et al.· 0 citations
: This paper presents an automated approach to deriving informal test cases from Requirements Interchange Format (ReqIF)-structured system requirements based on general-purpose Large Language Models (LLMs) with integrated linkage to test evidences based on Digital Dependability Identities (DDIs). Our method enables scenario-based testing while drastically reducing effort and cost: test cases become available within hours instead of months. The automation supports formal traceability, safety argumentation, and change impact analysis. An automated conversion of derived test cases into ASAM OpenScenario (XOSC) and Open Test Sequence Exchange (OTX) formats accelerates design and implementation of platform-independent, executable test specifications while improving their reuse across development stages. A systematic review process allows domain experts to refine and extend generated specifications. We discuss testbed configuration including resource allocation, toolchain integration, and parameter initialization to satisfy test constraints and strengthen confidence in results against the original acceptance criteria. Finally, we execute the reviewed test cases in a simulated environment within a Virtual Continuous Testing (VCT) pipeline for efficient verification and validation in an X-in-the-Loop (XiL) testbed based on VCIP/FERAL. The closed-loop approach advances automated testing by combining efficiency, consistency, and scalability in test generation, which is showcased within an automotive use case.
Adam Bachorek, Stefan Schwenk, Naveed Akram et al.· International Conference on...· 0 citations
This study investigates whether a frontier LLM can generate Dockerfiles and Docker Compose configurations for multi-service applications using repository contents without access to developer-authored deployment artifacts and analytically derives a minimal explicit deployment specification for information that cannot be reliably inferred from repository artifacts.
Oleg Grynets, Kyrylo Fursov, V. Lyashkevych et al.· arXiv.org· 0 citations
End-to-end GUI testing is essential for verifying web applications, yet existing evaluations rely on predefined checklists and are confined to the data and frameworks of web generation benchmarks, leaving the bug-discovery ability of vision-language models (VLMs) systematically untested. We introduce \textbf{C}ode-driven \textbf{A}gentic \textbf{T}esting (CAT), a paradigm in which the agent writes Playwright code to drive the browser, gathers feedback, and autonomously explores web applications to uncover bugs. We instantiate CAT with CATJudge, an agentic framework that unifies Browser-Use and Computer-Use tools within a single environment and CATTest, a benchmark of 102 AI-generated web applications with carefully annotated bugs, built through close human-AI collaboration to feature complex interactions and subtle defects. Experiments with mainstream VLMs show that all evaluated models perform poorly, revealing a clear gap between current VLM capabilities and the demands of real-world testing in AI web development. We release our code and data at https://github.com/SleepyWithoutCoffee/CATJudge.
Bin Hong, Zhen-Chao Zhang, Ji-Yuan He et al.· 0 citations
A Domain-Specific Language (DSL), named RI language, designed for the declarative description of microservices, along with a supporting tool, TSE (Toolbox Service Executor), implemented in Python and based on the RI grammar, enables the representation of structural and operational aspects of services in a technology-agnostic manner.
Cássio Ritse, Machado Dos, Santos Silva et al.· 0 citations
Microservice-based systems evolve continuously through API changes, service splits and merges, dependency churn, and deployment-topology drift driven by DevOps practices. This rapid evolution erodes the assumptions encoded in formal models, test suites, and architectural descriptions, leaving practitioners with limited guidance on how to keep verification artifacts aligned with evolving implementations. Prior surveys cover microservices design, deployment, performance, and isolated verification techniques, but, to our knowledge, none consolidate the intersection of evolution and formal/rigorous verification, nor map how repository-derived signals and CI/CD pipelines support continuous verification of microservice-based systems. This paper addresses that gap through a systematic literature review (SLR). Following the Kitchenham et al. guidelines and PRISMA-style reporting, we defined a review protocol with four research questions covering (i) formal modeling and verification approaches, (ii) the impact of architectural and API evolution on verifiability, (iii) repository-derived signals for updating formal artifacts, and (iv) continuous and incremental verification in CI/CD pipelines. Structured searches in IEEE Xplore, ACM Digital Library, SpringerLink, and Scopus returned 1187 records, which were screened in seven stages and reduced to 18 included studies (13 primary studies that supply evidence and five background studies retained for transparency and framing) through inclusion/exclusion criteria and a weighted 15-item quality-assessment instrument. We synthesized the included studies thematically and compared them along five dimensions: verification technique, evolution dimension, automation level, empirical evidence, and tool/artifact availability. The synthesis shows that actor-based model checking, TLA+ control-plane verification, static code analysis, continuous certification, and runtime/self-adaptive testing form five complementary clusters, but empirical evaluation is dominated by small academic case studies, only a minority of approaches automate model updates from repository signals, and few are integrated end-to-end into CI/CD. We discuss methodological limitations of the body of work, including a lack of industrial-scale validation and shared datasets, contrast intrinsic (build-time, model-driven) and extrinsic (recovery-based) verification strategies, and outline a research agenda toward repository-aware, pipeline-integrated verification for evolving microservices. The present synthesis distils a set of immediate, evidence-based actions for practitioners together with a focused agenda of open research challenges.
R. Gómez, Ebeid Elsayed, Enrique R. Zarate et al.· Software· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
