A Lightweight Dual-Branch Visual Front-End for Efficient Audio-Visual Target Speaker Extraction
Audio-Visual Target Speaker Extraction (AVTSE) uses face-related visual cues to extract a target speaker from a speech mixture. In many AVTSE systems, visual features are obtained from convolutional image encoders, and their computation may become a non-negligible part of the overall system when lightweight separation...