Joshua Penman

Semantic Overlays: Mitigating Prompt Injection with Annotations Beyond Tokens and Steering Vectors

This work introduces a general steering technique called Semantic Overlays: small learned adapters applied at chosen prefill positions to a frozen model's residual stream that defends against the broad class of prompt injections that add instructions in untrusted context.