This work finds that models cannot reliably reconstruct the original meaning and layer-wise probe classifiers fail to detect the harmful intent of perturbed prompts, and perturbations can occasionally reduce attack success by inducing off-topic or incoherent responses.
Attention Diversion explains why inference-time strategies, including chain-of-thought prompting, spell-checking, self-repair, and stronger repair models, fail to consistently recover performance: each addresses one channel at a time.
Jiaqi Zhu, Yang Zhang, Jun-Hua Ding et al.· 0 citations
Recent jailbreak attacks demonstrate that large language models (LLMs) can be manipulated to generate harmful outputs through adversarial prompts even after robust alignment. However, prevailing methods typically focus on forcing a desired response at the output layer—a surface-level strategy that is brittle and often...
Zichu Ren, Donghai Zhu, Haibo Hong et al.· IEEE Internet of Things Jour...· 0 citations
It is shown that the strength of this signal depends on text length and sampling range: spectral evidence is clearest for long, continuous, constrained generation, while short, fragmented, mixed, and edited settings require complementary confidence and fluctuation views.
Haitong Luo, Xuying Meng, Wei-Yao Zhang et al.· 1 citation
This work proposes TinyAttack, a novel adversarial attack framework designed to exploit vulnerabilities in LLMs through Unicode-based stylistic transformations, which utilises five Unicode variants to modify the visual rendering of text without altering its underlying semantic or syntactic structure.
M. Mamta, B. Grecu, O. Cocarascu· Annual Meeting of the Associ...· 0 citations
This work formalizes this phenomenon as incomplete prompt jailbreaks (IPJ) and provides a systematic empirical characterization of when and how incomplete prompts elicit harmful continuations, and identifies two functional neurons: termination and continuation neurons.
Y. Kim, Bumjin Park, Jaesik Choi· Annual Meeting of the Associ...· 0 citations
This work investigates the impact of cross-lingual prompt injection attacks on LLM-based relevance judgments using TREC Deep Learning collections and two open-weight models under established prompting frameworks, and demonstrates that multilingual query-based injections are highly effective in inflating relevance score...