Skip to content
#explainable ai Open access

Explainable Artificial Intelligence for Computer Vision: A Comprehensive Study on Interpretability Techniques, and Applications

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)
Explainable Artificial Intelligence (XAI)

Abstract

Abstract Convolutional neural networks (CNNs) have achieved state-of-the-art performance across computer vision tasks, including image classification, object detection, and medical image analysis. However, the opaque, black-box nature of these models limits their adoption in high-stakes domains such as healthcare, autonomous driving, and security, where accountability and trust are essential. Explainable Artificial Intelligence (XAI) has emerged as a critical research direction that seeks to make the decision-making process of deep models transparent and interpretable to human users without materially sacrificing predictive performance. While prior work has largely evaluated individual explainability techniques in isolation, few studies jointly deploy and quantitatively compare complementary explanation modalities within a single inference pipeline. We review recent literature published between 2023 and 2026, categorize explainability methods along the model-agnostic/model-specific and global/local dimensions, and provide a detailed technical analysis of five widely used techniques: Local Interpretable Model-Agnostic Explanations (LIME), SHapley Additive exPlanations (SHAP), Gradient-weighted Class Activation Mapping (Grad-CAM), Integrated Gradients, and saliency/attention-based maps. Building on this analysis, we propose an XAI-integrated computer vision framework that couples a fine-tuned Residual Network (ResNet-18) classifier with Grad-CAM, SHAP, and LIME explanation modules, and introduce an Explainability Consensus Score that quantifies the spatial agreement among the three explanation modalities for a given prediction. The framework is designed and specified for evaluation on the Chest X-ray Pneumonia dataset, with a complete evaluation protocol, planned performance metrics, and explainability-agreement metrics defined in advance of full experimental deployment; quantitative results will be reported following implementation and are intentionally not fabricated in this manuscript. Based on the reviewed literature and the qualitative behavior of the proposed explanation modules, we argue that combining local (SHAP, LIME) and gradient-based (Grad-CAM) explanations is expected to improve diagnostic transparency over any single technique used in isolation, a hypothesis the proposed Consensus Score is designed to test quantitatively. The paper concludes by discussing open challenges, including explanation faithfulness, computational overhead, bias propagation, and the evaluation of explainable vision transformers, and outlines future research directions toward standardized, responsible, and human-centered explainable computer vision systems. Keywords: Explainable Artificial Intelligence, Computer Vision, Deep Learning, Convolutional Neural Network, Grad-CAM, SHAP, LIME, Explainability Consensus Score, Model Interpretability, Trustworthy AI.

View source

Similar papers

#artificial intelligence Conference Open access Apr 2020

ECCOLA - a Method for Implementing Ethically Aligned AI Systems

The method, ECCOLA, is presented, which aims at making the high-level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.

Ville Vakkuri, Kai-Kristian Kemell, P. Abrahamsson · 64 citations · ⚡6
#computer vision Review Apr 2024

AI-powered Code Review with LLMs: Early Results

The goal is to not only refine the accuracy of the LLM-based tool but also to underscore its potential in streamlining the software development lifecycle through proactive code improvement and education.

Z. Rasheed, Malik Abdul Sami, Muhammad Waseem et al. · 62 citations · ⚡3
#computer vision Open access Mar 2024

LLM-based agents for automating the enhancement of user story quality: An early report

The use of large language models to automatically improve the user story quality in Austrian Post Group IT agile teams is explored, with a reference model for an Autonomous LLM-based Agent System developed and implemented at the company.

Zheying Zhang, M. Rayhan, Tomas Herda et al. · 48 citations · ⚡4
#computer vision Review Mar 2024

System for systematic literature review using multiple AI agents: Concept and an empirical evaluation

This paper introduces a novel multi-AI-agent system designed to fully automate SLRs, and demonstrates how it substantially reduces the time and effort traditionally required for SLRs while maintaining comprehensiveness and precision.

Abdul Malik Sami, Z. Rasheed, Kai-Kristian Kemell et al. · 44 citations · ⚡2
#computer vision Feb 2024

Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysis

The proposed LLM-based multi-agent system automates qualitative data analysis process, creating opportunities for researchers and practitioners, and future improvements focus on enhancing multilingual performance and integrating continuous expert feedback.

Z. Rasheed, Muhammad Waseem, Aakash Ahmad et al. · 41 citations
#artificial intelligence Conference Open access Jun 2018

The Key Concepts of Ethics of Artificial Intelligence

It is suggested that the focus on finding keywords is the first step in guiding and providing direction for future research in the AI ethics field.

Ville Vakkuri, P. Abrahamsson · 39 citations · ⚡2

Related blog posts

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.