Skip to content
Book Open access

Intent-Aware Backchanneling for Active Listening in Human-Robot Interaction

Aug 2026 · Message Understanding Conference · pp. 617-622 · 0 citations · 22 references
Computer Science

TL;DR

A ready-to-deploy intent-aware system in which a social robot conveys active listening through non-verbal backchannels grounded in interactional intents to enable active listening for robots.

Abstract

In conversational Human-Robot Interaction, robots typically remain silent during user speech and reply only after a pause, making interaction feel unnatural. In contrast, humans signal that they listen through active behavior. To overcome this, we present a system in which a social robot conveys active listening through non-verbal backchannels grounded in interactional intents. The system combines two ideas: (i) a dual-stage framework separating the user’s communicative intent (Speaker Intent) from the robot’s interactional stance (Listener Intent), mapping the latter to non-verbal reactions; and (ii) a parallel pipeline whose chunk-level branch generates non-verbal feedback during speech while a turn-level branch produces the verbal reply at turn end. We deployed this system on a robot and conducted a usability study (N = 6) in a hotel-negotiation task. We found that participants considered the system usable and could interpret gestures. We contribute a ready-to-deploy intent-aware system to enable active listening for robots.

Read PDF

Similar papers

Open access Sep 2026

Affect-aware conversational adaptation in mixed reality procedural tasks

A mixed-reality conversational system that integrates voice interaction, LLM-driven dialogue, and prosody-based affect-aware adaptation with a modular client–server architecture is presented, enabling emotion-related cues inferred from vocal prosody to be incorporated without interrupting conversational flow.

Andrea Antonio Cantone, Matteo Ercolino, M. Sebillo et al. · 0 citations
Preprint Sep 2026

MIRA: Real-Time Full-Duplex Human-Robot Interaction for Embodied Companions

This work presents MIRA, a unified framework for real-time full-duplex embodied companion interaction, and designs CORTEX, a dual-timescale interaction policy that combines low-latency barge-in preemption and streaming response generation with deliberative turn decisions, backed by a robot-side execution layer that enf...

Li-Jian Lin, Ye Zhu, Fan Zhang et al. · 0 citations
Review Sep 2026

EmoPose: Vision-Language Model Guided Emotion-Aware Gesture Generation for Humanoid Robots

Socially competent humanoid robots must communicate affect and intent through gesture as well as speech, yet open-ended interaction must become motion that is both expressive and executable on a specific body. This demands semantic flexibility for contextual social intent while preserving deterministic, embodiment-awar...

Dao-Jie Peng, Bing-Tao Wang, Fu-Long Ma et al. · 0 citations
Preprint Sep 2026

Multimodal Voice Activity Projection for Social Robot Mediation: Expected Behavior and Deployment Constraints

Turn-taking prediction is especially relevant for social robots that act as mediators in human-human interaction, where the expected action is often not to speak, but to orient, wait, avoid interruption, or prepare a balanced intervention. This paper presents Multimodal Voice Activity Projection (MM-VAP) as a human sta...

Antonio Cano, Guillermo Pérez, Luis Merino et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.