Oct 2026· Information Processing & Management· 24 references
Software System Performance and Reliability
Abstract
AI information service platforms must allocate heterogeneous requests across models, memory, clarification, and human review under joint resource constraints. We develop CAST, a cognition-aware five-action service-triage framework; CAST-ERM learns group-level empirical allocations, and CAST-DRO adds a configurable mean-plus-variability adjustment. Using sequence-grouped train/evaluation splits for 520 LifeSim-derived evaluation requests across 20 repeated splits, CAST-DRO improves over rule-based CAST in quality (0.679 to 0.743), failure rate (0.617 to 0.350), and final satisfaction (46.35 to 56.51), while reducing normalized high-value resource cost (0.087 to 0.081). CAST-ERM reaches quality 0.738, confirming that cognition-group empirical allocation explains most of the average gain. The risk adjustment changes 12 of 104 eligible group-seed action selections and sharply reduces selected-action loss variability in the medium-risk group. A LinUCB comparison warm-started with full-information simulator outcomes reaches quality 0.744 with high-value cost 0.092. A strict budget audit finds zero human, memory, or total-spend violations for all four hard-budget policies across all 20 splits. Resource-price and capacity tests retain a positive quality advantage over CAST, although high-value resource use depends on the bottleneck. In a two-layer stress test, separate mandatory safety-review capacity of 30% reduces latent-reference high-risk miss from 0.788 to 0.230, with 0.035 overflow and 0.398 total escalation. Real-model evaluation on 100 requests and anonymized 1–5 ratings of 50 request–response pairs provide supporting, not production-level, validation. CAST-DRO is best interpreted as an auditable middle-layer allocator after mandatory safety filtering.
The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.
Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson· EUROMICRO Conference on Soft...· 64 citations· ⚡6
The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.
Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al.· arXiv.org· 62 citations· ⚡3
The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.
Zheying Zhang, M. Rayhan, Tomas Herda et al.· International Conference on...· 48 citations· ⚡4
This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.
Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al.· arXiv.org· 44 citations· ⚡2
The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.
Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al.· arXiv.org· 41 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 8, 2026
Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.