Leakage compares two models, so it can be certified from unlabeled traffic with anytime-valid tests whose sample cost the authors bound from above and below, and per-update certificates compose into a bound on lifetime drift outside all declared scopes.
The safety of a tool-using language model agent is usually treated as a property of the model alone. We give controlled, full-precision evidence that it is instead a joint property of the model and the software that renders its chat template and parses its tool calls, the decoding harness, and that both halves are atta...
Muhammad Usama, Khairatul Nisa, Summer Yeoreum Jung· arXiv.org· 0 citations
System prompts are the primary lever practitioners use to control language model behavior, yet what they actually do to the computation inside the transformer remains poorly understood. Across 17 instruction-tuned models spanning 8 architecture families and 1.5B to 72B parameters, we use Centered Kernel Alignment (CKA)...
Muhammad Usama, Dong Eui Chang· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.