Shun-Yuan Bai

Answer It or Not? Towards Prompt-Adapted Adversarial Images on Vision Language Models

With the advancement in language modeling, research on adversarial images has recently shifted from image classifiers to vision-language models (VLMs). Despite the new, text-prompt-driven nature of VLMs, we find that existing VLM adversaries have largely overlooked the dynamics of text prompts. In a typical use case, a...