Generalization in large language models (LLMs) is the ability to produce consistent and semantically stable outputs when the same input is expressed in different ways. Existing work typically evaluates generalization through aggregate accuracy on a single prompt format, task, or set of variations, which conflates robus...
Nagham Omar, Mahmoud Jabarin, M. Rozenshteĭn et al.· 0 citations
A KV-cache fork is introduced for single-position probes: a short fixed suffix appended after the user message lets the probe read a few tokens downstream of the perturbation, exploiting its rapid spatial decay.
It is shown that diffusion remasking can promote recovery from harmful intermediate generations, provide evidence that this behavior is tied to the sampling mechanism, and demonstrate that switching from AR to diffusion sampling improves jailbreak robustness, including under fixed model weights.
Eliron Rahimi, Elad Hirshel, Rom Himelstein et al.· arXiv.org· 2 citations
The same method is used to select the best training datasets for prompt-injection classifier probes: while similarity between ordinary activations is almost unrelated to downstream performance, RFD-based similarity achieves Top-1 and Top-2 accuracy.
Amit Levi, Elad David, M. Fomin· arXiv.org· 0 citations
ANTAP (Automatic Non-Textual Agent Picker), an evaluation-driven routing architecture that discards indirect proxies in favor of active capability testing, is introduced, which distills performance into fixed behavioral operators within a shared semantic space.
Dvir Alsheich, Adar Peleg, Ben Hagag et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.