To quantify collaboration effectiveness in addition to conventional binary task success, Causal Collaboration Effectiveness (CCE) is proposed, a graph-based metric that traces causal dependencies between agent actions and measures what fraction of a team's effort actually contributed to the outcome.
Raphael Shu, Yu-Sen Zhang, Y. Cho et al.· 0 citations
DoubleAgents is presented, a system for human–agent alignment in coordination tasks, grounded in distributed cognition that introduces interactive simulation as a methodological testbed for rapid iteration and alignment testing of agentic systems.
Tao Long, Xuan-Ming Zhang, Si-Tong Wang et al.· Proceedings of the 2026 ACM...· 1 citation
These results show that current agents are still far from professional-level computer use: rather than stumbling on basic GUI control or coding, they lose track of constraints, miss information that arrives mid-task, guess rather than ask the user, and skip verification, struggling most when a task hinges on hidden sta...