Root cause analysis (RCA) in microservice systems is challenging because observable symptoms often propagate along service dependencies and become separated from the actual underlying cause. Recent large language model (LLM)-based agent frameworks have shown promise for automating RCA, but existing methods still suffer from uncontrolled context growth, weakly constrained diagnostic workflows, and unreliable conclusions under inconsistent evidence from multiple sources. To address these issues, we propose Context-RCA, a context-controlled multi-agent framework for microservice fault diagnosis. Context-RCA has three key components. First, it uses selective context injection to organize agent inputs through domain isolation, stage awareness, and dynamic context updates. Second, it uses an SOP-driven workflow to enforce structured diagnosis across stages and prevent premature conclusions before sufficient evidence is collected. Third, it uses iterative consensus verification to cross-check hypotheses against logs, metrics, and traces and refine judgments from observed symptoms to deeper root causes. Experiments on 400 fault cases from the 2025 International AIOps Challenge dataset show that Context-RCA achieves an overall score of 65.93 on DeepSeek-V3.2 and 60.06 on GPT-4o, outperforming the strongest baseline by 14.21% and 24.30%, respectively. Context-RCA also improves fault localization and root cause description quality. Ablation results further show that selective context injection contributes a 5.51% gain, confirming context control as a primary factor in reliable RCA with LLMs.
Jun-Chi Kang, Xunhui Zhang, Yuanzhao Zhai et al.· Fall Joint Computer Conferen...· 0 citations
AI agent systems increasingly support software engineering by extending large language models with capabilities such as planning, tool use, and coordinated execution, yet empirical evidence on the engineering challenges of building and maintaining such frameworks remains limited. To fill this gap, we conduct a large-scale empirical study of 3,864 closed GitHub issues from three representative repositories. We present a taxonomy of engineering challenges comprising 5 top-level categories and 21 subcategories, analyze the popularity and difficulty of these categories, and summarize 47 actionable solution strategies from resolved issue discussions and linked pull requests. These findings provide practical guidance for developers and framework providers, and offer an empirical basis for future research on AI agent engineering.
Chen Liu, Xunhui Zhang, Tao Wang· Fall Joint Computer Conferen...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.