LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning
Prior audio-visual self-supervised learning methods rely on mechanisms such as EMA target encoders, prediction heads, reconstruction decoders, and contrastive losses. We introduce LeAVJEPA, the first audio-visual encoder trained under LeJEPA's collapse-free objective. A single early-fusion Vision Transformer processes...
B. Robson, Santeri Mentu, Wen-Shuai Zhao et al.
· 0 citations