Hai-Zhou Li

Dialogue-Based Streaming Audio-Visual Target Speaker Extraction with Predictive Dialogue Information

This work proposes an LLM-based target-speaker voice activity projection (TS-VAP) module, which forecasts the future activity of the target and conversational partner directly from the overlapping mixture, drawing on the linguistic and conversational knowledge of a speech-LLM, and uses this prediction to guide a low-la...