Computer-use agents need to capture procedural knowledge of how people use software. User telemetry offers a scalable source of this knowledge. However, learning reusable skills from these logs requires addressing three challenges: (1) Goal Underspecification, since logs do not record the goal behind each action; (2) N...
J. Chen, Elias Stengel-Eskin, Yan Chen et al.· 0 citations
Generative AI is transforming the workplace by augmenting and automating cognitive tasks, reshaping how organizations work and innovate while raising questions about workplace inequality and the future of work. Despite rapid adoption, empirical evidence on how these tools alter work practices and generate productivity...
Multimodal large language models (LLMs) increasingly integrate vision and text, yet how people use them in natural settings remains underexplored. We seek to answer the question: when users upload images, what tasks are they trying to accomplish? Analyzing over 40,000 de-identified image-upload conversations from Micro...
Jin-Yi Ye, Scott Counts, Gaurav Verma et al.· 0 citations
A multi-resolution vocabulary of semantically normalized operators, recurring motifs, coherent episodes, and day-level rhythms, each preserving the structure salient at its own horizon is constructed, each preserving the structure salient at its own horizon.
Lin Ai, Scott Counts· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.