AgentInspect: Diagnosing Behavioral Failures in Artificial Intelligence Agents
This work developed AgentInspect, a framework that automatically detects six types of behavioral failures in LangChain-based AI agents by analyzing their execution trajectories across three evaluation settings: a baseline setting using real tool responses, a simulated setting incorporating synthetic tool responses, and a hybrid setting that combines the real and simulated tool responses.
Ruchira Manke, Mohammad Wardat, Hridesh Rajan et al.
· 1 citation