Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates, is introduced and shows that prompt injection robustness can be achieved and improved through targeted attention interventions.
Igor Shilov, Xiao-Xue Yang, Alexander Panfilov et al.· 0 citations
This work introduces Argument Graph Uncertainty, a post-hoc framework for multiple choice question tasks that estimates model confidence directly from the logical structure of a single chain-of-thought reasoning trace, and demonstrates through extensive combination analyses that argument graph uncertainty captures an o...
S. Baur, Sumire Honda, W. Samek et al.· 0 citations
Lie detection probes aim to predict from a language model's internal states whether its output is truthful or dishonest. However, role-play complicates what"truth"means for an LLM: language models can adopt a wide range of personas that take very different claims to be true, including personas whose beliefs clearly con...
Maximilian von Klinski, S. Lapuschkin, W. Samek et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.