Amir Ivry

AnchorPrompt: Self-Distilled Soft Prompts for Robust Audio-Language Models

Large audio-language models (LALMs) are sensitive to input perturbations, such as noise, waveform corruption, and adversarial injections. We propose AnchorPrompt, an efficient adaptation method that keeps the model frozen and learns a single block of prompt vectors inserted at the decoder input, between the audio and q...