Tongtao Ling

Separate First, Then Associate: A Two-Stage Approach for Real-World Audio-Visual Speech Enhancement

This work proposes a decoupled separation-then-association approach for AVSE, which consists of a separation stage in which a trained, audio-only model is used to separate input multi-speaker mixture to individual speaker signals, followed by an association stage where an audio-visual CLIP model is used to identify the...