From Answer Production to Defensible Engineering Judgment in AI-Containing Systems: The iSCARB Framework and a Nine-Chapter Software Engineering Implementation
Sep 2026· Zenodo (CERN European Organization for Nuclear Research)
Abstract
Generative AI makes fluent artifact production inexpensive, weakening assessment validity when a submitted answer is treated as sufficient evidence of student capability. At the same time, software engineers increasingly build systems in which learned components sit inside larger socio-technical systems and can fail without conventional software failure signals. This preprint presents iSCARB, a course-level design that treats defensible engineering judgment, rather than answer production, as the observable assessment target. A defensible judgment requires the learner to select a fit option (FIT), state an observable boundary beyond which it ceases to be fit (BOUND), translate the judgment into action (ACT), provide inspectable evidence (EVIDENCE), commit to these before a changed condition (STRESS) is revealed, and then retain, revise or replace the original judgment with justification (REFIT). These mechanisms do not prove internal cognitive ownership; they create observable evidence that a learner can defend and revise a consequential decision. We report implementation across nine chapters of an undergraduate Software Engineering II course at King Abdulaziz University and an extension that threads an AI component through each chapter. The extension is intentionally a transfer layer rather than a new formal learning outcome: the five objectives, readings, self-checks and assessed assignments remain unchanged while existing software-engineering concepts are applied to AI-containing systems. Each chapter instantiates a different engineering stance toward the learned component, from doubting and measuring it to bounding, contracting, retrying and negotiating it across owners. We map the implementation to CS2023, report design iterations and automated quality assurance, and specify a planned evaluation of defensibility, revision, dependency reasoning, metric choice and instructional load. We make no claim of causal effectiveness, superiority or accreditation.
The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.
Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson· EUROMICRO Conference on Soft...· 64 citations· ⚡6
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 62 citations· ⚡3
A comprehensive overview of how enhanced sampling methods are reshaping the field, with a particular focus on the data-driven construction of collective variables, is provided.
Kai Zhu, Enrico Trizio, Jintu Zhang et al.· Chemical Reviews· 58 citations
The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.
Zheying Zhang, M. Rayhan, Tomas Herda et al.· International Conference on...· 48 citations· ⚡4
This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.
Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al.· arXiv.org· 44 citations· ⚡2
The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.
Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al.· arXiv.org· 41 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026
Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.