Jorge Diaz Chao

Interactively Teaching Collaborative Physical Tasks to Generative AI with Narrated Demonstrations

Enabling users to teach computers how to perform physical tasks is a long-standing goal in HCI. Prior work has explored learning from demonstration, but demonstrations often underspecify intent. Advances in generative AI enable a combination of demonstration and verbal narration to disambiguate intent. However, it rema...