Hao-Tian Qi

CAST-ASD: Causal Attention over Speakers and Time for Online Active Speaker Detection

We present CAST-ASD (Causal Attention over Speakers and Time), a causal joint model for active speaker detection (ASD). Recent ASD models improve performance by jointly processing all faces in a scene, but operate offline, with the full clip available before any frame is labelled. Low-latency causal detectors instead p...