Across three visual tasks, it is shown that pathway selection is task-dependent, and that data distribution and prompt design can also modulate which pathway is used to solve the image-based query.
Israfel Salazar, Stella Frank, Dan Oneata et al.· arXiv.org· 3 citations· ⚡1
This model couples a frozen Wav2Vec2-BERT audio encoder with a frozen E5 text encoder and aligns them through small trainable projection heads, using a contrastive objective that combines a cross-modal supervised-contrastive loss with intra-modal terms.
Cristian-Teodor Neamtu, Serban Mihalache, Stefan Smeu et al.· 0 citations
This work demonstrates that cross-lingual word-to-speech mappings can be learned directly from visual grounding without transcriptions or explicit model training.
Gabriel Pirlogeanu, Dan Oneata, H. Cucu et al.· 0 citations
This work uncovers a surprisingly consistent phenomenon: across multiple pretrained models, datasets, and both image and video domains, fake samples systematically produce lower-magnitude representations than their real counterparts.
Stefan Smeu, Dragos-Alexandru Boldisor, Elisabeta Oneata et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.