OmegaUse-SOP is introduced, a human-in-the-loop SOP Engineering system for transforming human demonstrations of professional computer use into reusable SOP skills for GUI agents, and the results suggest that OmegaUse-SOP can improve GUI-agent reliability on professional SOP tasks.
Yixiong Xiao, L. An, Hu-Cheng Yang et al.· 0 citations
This work develops an alternative, retrieval-based account of human oversight and posit that error detection is more effective when oversight-relevant information is accessible to users at the moment of review, and shows that self-generated explanations improve error detection and strengthen recall of verification-rele...
The results identify user evaluability as a planning-relevant dimension of AI assistance, complementary to generation quality and preference inference, complementary to generation quality and preference inference.
Yi-Fan Zhu, Sammie Katt, Samuel Kaski· 0 citations
Multimodal large language models (MLLMs) have made significant progress in chart understanding, generation, and editing, but their ability to annotate existing charts remains underexplored. Annotating charts is a common yet challenging communicative task, requiring models to infer intended messages, interpret chart sem...
Zhenghan Chen, Zekai Shao, Lidan Tan et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Physical human-robot interaction requires yielding transiently to contact yet recovering the commanded reference under sustained load. Finite-stiffness impedance control retains a static deflection there, while predictive alternatives typically optimize a nonlinear robot or impedance model online. Operational-space can...
Community-based fact-checking systems, such as X's Community Notes program, offer a potentially scalable approach against online misinformation diffusion. However, their efficacy is substantially undermined by the delay of fact-check delivery. To address this challenge, we investigated the promise of organic user comme...
Shuning Zhang, Dai Shi, Yuwei Chuai et al.· 0 citations
This SoK examines 134 relevant papers on privacy concerns in motion patterns recorded by XR headsets, including how adversaries can obtain users'motion patterns, the inferences they can draw from them, and methods for protecting users and clarifies the state of XR motion privacy.
Azim Ibragimov, Alina Vasina, Uliana Polshcha et al.· 1 citation
This work proposes an audio system that can be used for both an attentive listening system with the android ERICA and a conversation support system with mobile Teleco robots, with one of them acting as an avatar for a remote operator.
Divesh Lala, Yogeeswaran Muthukumaran, Vincent Fernandes et al.· 0 citations
Graphic designers often blend visual concepts to communicate multiple ideas within a single image, leveraging positive and negative space to create balance, emphasis, and aesthetic appeal. While computational methods have begun to support automatic concept blending, they largely overlook the role of spatial composition...
Shishi Xiao, Adam J. Coscia, David H. Laidlaw· 0 citations
Immigrant-led nonprofit groups, particularly those operating in politically sensitive contexts, face exclusion from formal registries and digital platforms. This paper reports a three-phase mixed-methods study with Iranian immigrant nonprofit practitioners: 27 semi-structured interviews, a co-design session, and 7 eval...
Three specialized heuristics are proposed that help developers manage complexity, provide contextual support, and improve accessibility for multidisciplinary research teams: Active Parameter Transparency, Point-of-Use Guidance, and Phased Feature Disclosure.
Yulia A. Levites Strekalova, Rachel Liu Galvin, Jessica Ray et al.· 0 citations
A between-subjects study with 30 participants comparing custom AR and mobile interfaces comparing equivalent information, measuring robot and environmental SA with the Situation Awareness Global Assessment Technique (SAGAT) across all three levels, with concurrent eye tracking to identify the attentional mechanisms und...
Zhe-Han Qu, Christian Fronk, J. Jeong et al.· 0 citations
Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 30, 2026
Able to defeat top-ranked human players and more efficient than other models, the new system could help decision-makers in military maneuvers or business negotiations.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.