The prevailing approach to computer-use agents couples a model with a domain-specific harness: a browser or desktop environment equipped with human engineered tools that are fixed before task execution. As models'coding capabilities improve, the GUI native and static harness prevents them from direct programmatic opera...
Ya-Dong Lu, Theo Lee, Yi-Fei Li et al.· 0 citations
The results demonstrate that full-duplex interaction, speech recognition and generation, general language capabilities, and external tool use can be integrated in a single open speech-to-speech model without sacrificing real-time conversational behavior.
Jagadeesh Balam, Travis M. Bartley, Edresson Casanova et al.· 2 citations· ⚡1
This work proposes DualSQL, a new Text-to-SQL system consisting of two agents powered by a single model backbone, enabling joint optimization through a robust multi-agent reinforcement learning (RL) framework, and introduces a new SQL correctness metric, robust execution match (REX), to more accurately judge SQL correc...
Shi-Jie Chen, Yu Gan, Yeounoh Chung et al.· 0 citations
These results show that current agents are still far from professional-level computer use: rather than stumbling on basic GUI control or coding, they lose track of constraints, miss information that arrives mid-task, guess rather than ask the user, and skip verification, struggling most when a task hinges on hidden sta...