Skip to content
Preprint

Located but Not Releasable: Silent Gate Inversion and Bounded Linear Release

Aug 2026 · 0 citations · 24 references
Computer Science

TL;DR

The complete pipeline -- detect, localize, and release -- is submitted to a fully preregistered stress test on a 25.7M transformer trained on causal-evidence discrimination, where a known suppression phenomenon (latent causal structure present but behaviorally unused) has previously been documented.

Abstract

A growing body of work reports that language models represent task-relevant latent structure that they fail to use. Whether such structure, once located, can be converted into behavior is a separate question that is rarely tested end to end. We submit the complete pipeline -- detect, localize, and release -- to a fully preregistered stress test on a 25.7M transformer trained on causal-evidence discrimination, where a known suppression phenomenon (latent causal structure present but behaviorally unused) has previously been documented. Every threshold, claim template, and decision-tree branch was hashed and archived before any corresponding data existed. Three findings. (i) Localization succeeds: interventions at observation-evidence channels of mid layers restore target behavior on otherwise-suppressed worlds (paired release advantages $0.563$ and $0.854$, 97.5% CIs excluding zero; best-site release rate $0.889$). (ii) Gating fails out of distribution: a detector calibrated to trigger on zero out-of-distribution calibration worlds triggers on 6.9-7.3% of held-out in-distribution generations and on zero of the 2,400 held-out generations that actually need it -- a complete inversion that silently reduces the gated pipeline to its base model. (iii) Linear release is capped: removing the gate and injecting a per-instance linear direction unconditionally yields a monotone dose-response that plateaus far below the preregistered release margin (intercept $0.382 \to 0.311 \to 0.264$ vs. threshold $\le 0.08$); per-instance adaptivity adds less than $\pm 0.03$. The failure is doubly located: the detector is OOD-inverted, and the entire family of linear release directions at this site and resolution is bounded away from sufficiency. The two failures are dissociable, and neither overturns localization. Every number traces to a hashed artifact in the released audit chain.

View source

Similar papers

Preprint Jul 2026

Faithfulness to Refusal: A Causal Audit of Neuron Selectors

Two paired audits built on one-shot neuron-row zeroing show that rank-stability proxies miss the kinds of selector failures a direct causal audit can surface, and audit selectors at the language-modeling level.

Ananth Eswar, Pratinav Seth, Utsav Avaiya et al. · 1 citation
Preprint Aug 2026

Decodable But Not Detachable: Training Data Granularity Determines Parametric Modularity in Large Language Models

This work applies a uniform causal methodology across two domain granularities, three model families, and eight domains to identify domain-specific parametric shells: concentrated, causally necessary neuron populations whose removal selectively degrades a target domain while sparing others.

M. Armstrong, Navid Ayoobi, Arjun Mukherjee · 0 citations
Preprint Jul 2026

Attention Degradation, Function Token Anchoring, and the Limits of Attention-Based Intervention in Large Language Models

It is concluded that mean attention degradation is largely descriptive rather than prescriptive: function tokens contribute through what their hidden states compute, not through the attention they receive -- with implications for interpretability methodology and attention-score-based inference optimisations such as KV-...

Sagar Dangal, Manoj Shakya · 0 citations
Preprint Aug 2026

Circuit Condensation: Post-Training that Concentrates a Behavior's Causal Circuit

Circuit Condensation is introduced, which post-trains models to concentrate behaviors into smaller causal graphs, which are smaller than the strongest frozen baseline in 30 of 32 settings, and shows that weight updates, rather than search alone, drive the reduction.

Sailesh I. S. Kumar · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.