UserProxyBench: Evaluating LLM User Simulators for Agent Benchmarks and Training
UserProxyBench, an evaluation layer over the tau-bench family, and the User Fidelity Score (UFS), which measures adherence to the benchmark's private user instructions using task-grounded rubric criteria scored independently of agent success are introduced.
Ashish Jain, Armaan Sandhu
· 2 citations
· ⚡1