Guarantees, dispositions and answerable judges: An empirical basis for the behavioural certification of tool-using language agents
Buyers of tool-using language agents ask for evidence that an agent respects the authority it has been given, and what they receive is usually the vendor's own account. We ask what an independent behavioural certificate can claim about an agent the certifier cannot inspect, using a deployed certification suite as the i...