This work addresses three challenges: finding conversational events in multilingual speech, evaluating their timing without reliable word-level alignment, and judging responses across languages with IndicFDB, which extends it to ten languages spoken in India with 12,350 samples.
Rajarshi Roy, Shobhit Banga, Jonathan Raiman et al.· 1 citation
The results demonstrate that full-duplex interaction, speech recognition and generation, general language capabilities, and external tool use can be integrated in a single open speech-to-speech model without sacrificing real-time conversational behavior.
Jagadeesh Balam, Travis M. Bartley, Edresson Casanova et al.· 2 citations· ⚡1
VoiceChat-TTS is proposed, a low-latency, continuous, and streamable text-to-speech model for interactive agents that enables always-on, responsive speech generation while preserving modularity and high speech quality.
Edresson Casanova, Jaehyeon Kim, Mariana Graterol Fuenmayor et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.