Multimodal agents increasingly rely on visual interfaces to perceive state and select actions, creating an attack surface not captured by text-only safety evaluations. We study Visual Semantic Hijacking, in which deceptive but semantically meaningful interface elements, such as forged system alerts, cause an agent to d...
Yu-Ke Wang, Ben-Lei Cui, Sheng-Yuan Pang et al.· 0 citations
Results reveal a systemic vulnerability of frontier VLMs to meta-adaptive jailbreaks to meta-adaptive jailbreaks and motivate defenses against meta-level adversaries.
Ben-Lei Cui, Sheng-Yuan Pang, Yu-Ke Wang et al.· 1 citation
Text-to-image (T2I) models can be exploited to produce unsafe images. Existing safety measures, e.g., content moderation or model alignment, can be weakened by adversaries who attempt to restore unsafe generation through model fine-tuning. This paper presents Patronus, a defensive framework that improves T2I models’ re...
Xin-Feng Li, Sheng-Yuan Pang, Jialin Wu et al.· IEEE Transactions on Informa...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.