Skip to content
Conference Open access

A Survey on Actionable Interpretability in Large Language Models

Sep 2026 · Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence · 1 citation · 94 references

TL;DR

This survey reviews LLM interpretability through the lens of actionability, presenting a taxonomy of attributional and mechanistic approaches, along with emerging methods tailored to vision–language models (VLMs), and examining how actionable interpretability supports downstream objectives.

Abstract

Large Language Models (LLMs) have become central to modern AI, with interpretability playing an increasingly important role in investigating the opaque and complex mechanisms encoded within billions of parameters and ensuring trustworthy deployment. However, descriptive interpretability approaches for LLMs remain largely post-hoc, explaining model behavior without actionable guidance for model improvement, thereby limiting their practical utility. Recent work has therefore shifted toward actionable LLM interpretability, emphasizing methods that connect internal mechanisms to interventions and model improvement rather than explanation alone. This survey reviews LLM interpretability through the lens of actionability, presenting a taxonomy of attributional and mechanistic approaches, along with emerging methods tailored to vision–language models (VLMs). We further examine how actionable interpretability supports downstream objectives such as hallucination mitigation, knowledge editing, fairness, safety, capability and efficiency. By positioning actionable interpretability as a pathway for better-guided LLM design and practice, this survey outlines key challenges and future directions toward trustworthy and controllable foundation models.

Read PDF

Similar papers

Open access Aug 2026

Towards Trustworthy Large Language Models

An integrated conceptual frame-work that couples attention- and perturbation-based explainability with lightweight hallucination-detection signals and token-efficient inference strategies is presented, and a set of cross-cutting consistency metrics are instrumented with a set of cross-cutting consistency metrics.

Sakshi Parate, Shreyans Sanyal · 0 citations
Book Open access Aug 2026

Interpretability in the Era of Large Language Models: Mechanistic Methodology, Empirical Practices, and Applications

This tutorial provides a comprehensive, end-to-end view of LLM interpretability, transitioning from microscopic neural analysis to macroscopic application and deployment, and explores how these interpretability paradigms scale and inspire the design of frontier architectures, agentic systems, and thinking models.

Wei Zhang, Zhengfu He, Lucia Zhang et al. · 0 citations
Preprint Aug 2026

Scaling Inherently Interpretable Language Models

Steerling-8B remains competitive with open peer models trained on substantially 2-16x more compute, suggesting a different scaling paradigm: interpretability can be designed into training, and it improves with scale.

Guide Labs Team, Andreas Madsen, A. Ismail et al. · 3 citations · ⚡1

From Plausible to Actionable: A Position on LLM Self-Explanations

It is argued that self-explanations can be highly plausible, questionably faithful, and yet highly actionable, and evaluation should extend beyond these criteria to actionability, highlighting applications of LLM rationalization capabilities that support informed decision-making and appropriate action across diverse st...

E. Herrewijnen, Benedetta Muscato, Gizem Gezici et al. · 0 citations
Conference Open access Sep 2026

Explaining Jailbreaks: Structured and Interpretable Safety Assessment for Large Language Models

This work proposes an explanation-aware safety framework that augments binary harmfulness detection with structured, human-interpretable explanations capturing severity, strategies, trigger spans, ratio-nales, and derived safety factors, and introduces a human–LLM hybrid annotation and canonicaliza-tion pipeline.

Sunghee Dong, Sungwon Yi, K. Bae et al. · 0 citations
Review Open access Aug 2026

Explainability of decoder-only clinical large language models: A scoping review

Findings show that clinical LLM explainability has shifted toward fluent generative rationales, but evidence that such explanations reflect model reasoning remains limited, and three regulatory priorities are highlighted: prioritizing explanations that enable independent verification or logic auditing over plausibility...

Nishant Mishra, A. Abu-Hanna, Iacer Calixto · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.