DuMateBench: Evaluating Autonomous Agents in Complex Real-World Workflows
DuMateBench, a real-session benchmark reconstructed from anonymized and privacy-screened user sessions collected from a large-scale production agent platform, is introduced, showing that performance under environmental perturbations is jointly shaped by the capabilities of the LLM and the surrounding agent framework.