Skip to content
Conference Open access

Mitigating Safety Context Amnesia in Multimodal Reasoning Models via Intent-Guided Safety Reasoning

2026 · Annual Meeting of the Association for Computational Linguistics · pp. 39249-39276 · 0 citations · 39 references
Computer Science

TL;DR

Intent-Guided Safety Reasoning (IGSR), an inference-time defense that operates without modifying target model parameters, is proposed, which improves defense success rates by over 62% compared to baselines, while largely preserving task utility.

Abstract

Recent advances in Multimodal Large Reasoning Models (MLRMs) have enabled explicit chain-of-thought inference across vision and language, substantially improving performance on complex reasoning tasks. Despite these gains, the reasoning process introduces a subtle yet critical vulnerability. We identify an un-derexplored multimodal safety failure mode in which harmful objectives are embedded within ostensibly benign contexts, leading models to over-prioritize narrative coherence during reasoning. We term this phenomenon Safety Con-text Amnesia (SCA), wherein models correctly perceive risk-relevant visual cues but fail to enforce safety constraints as the reasoning process becomes dominated by contextual alignment. To mitigate SCA, we propose Intent-Guided Safety Reasoning (IGSR), an inference-time defense that operates without modifying target model parameters. IGSR employs a Perception Decoupler to extract objective visual evidence into a structured intent output, followed by a Cognitive Arbiter that enforces explicit safety constraints prior to generation. Extensive experiments across multiple multimodal safety benchmarks demonstrate that IGSR improves defense success rates by over 62% compared to baselines, while largely preserving task utility. These results highlight the critical role of structured, intent-aware reasoning in achieving robust safety reasoning for multi-modal reasoning models. Warning: This paper contains unsafe examples.

Read PDF

Similar papers

Book Open access Aug 2026

Causal Abstraction Learning for Multi-Modal Grounded Planning

Recent advances in multimodal embodied agents have enabled long-horizon planning in visually rich environments via natural language. Yet, their generalization remains brittle when task instructions deviate from familiar examples, exposing a reliance on surface imitation rather than structural understanding. We propose...

Xinshu Li, Shiyi Yang, Ziqi Xu et al. · 0 citations
Jul 2026

RetroHolmes: When Semantic Plausibility Fails Retrospective Physical Process Reasoning

Humans can infer hidden physical processes from sparse observations, yet current evaluation protocols for Vision Language Models fail to assess whether such physical reasoning is genuinely captured. To address this gap, we introduce Retrospective Physical Process Reasoning, a new evaluation paradigm to reason backward...

Ruoxuan Zhang, Qiyun Zheng, Siyu Wu et al. · 0 citations
2025

Dependency Matters: Enhancing LLM Reasoning with Explicit Knowledge Grounding

Grounded Reasoning in Dependency (GRiD) is introduced, a novel dependency-aware reasoning framework that explicitly grounds reasoning steps in structured knowledge that substantially improves reasoning accuracy, consistency, and faithfulness compared to recent state-of-the-art structured reasoning methods.

Xiangyu Wen, Min Li, Junhua Huang et al. · 2 citations
Preprint Aug 2026

Cognitive Demand Steering for Adaptive Meta-Reasoning in Large Language Models

CDS is introduced, a training-free meta-reasoning framework equipped with residual demand assessment: at each step, an LLM-based progress evaluator characterizes the residual reasoning required to arrive at a solution rather than merely evaluating the previous step.

John Scoville, Shengzhuang Chen, Yejin Bang et al. · 0 citations
Preprint Aug 2026

Before Reasoning Can Fail: Pre-Evidence Procedural Failures in Agentic RAG

It is shown that evidence-gathering should be evaluated as a trajectory-level control problem, separately from answer-side reasoning, because larger hidden thinking budgets do not necessarily increase evidence inspection.

Daeyoung Roh, Donghee Han · 0 citations
Preprint Aug 2026

TRACE: An Evidence-Grounded Benchmark for Safety Evaluation of Large Reasoning Models

TRACE is introduced, an evidence-grounded safety evaluation benchmark that covers the entire LRM inference pipeline: prompts, reasoning traces, and final responses, and reveals that safety judgment for reasoning traces is substantially more challenging than for prompts or final responses, and that current models strugg...

Zhenyu Wu, Siyu Chen, Chang-Chun Yang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.