PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents
This work proposes PROBE (Policy Rule Observation via Behavioral Exploration), an algorithm for training LLM-based auditors that interact with deployed agents as realistic users and probe them for policy violations through multi-turn, tool-mediated dialogue, and formalizes agent auditing as a two-player Markov game.