Focusing on zero-shot classification, this study demonstrates that 3D vision-language models exhibit heightened sensitivity to small coordinate perturbations, highlighting the need for a more rigorous security evaluation of 3D vision-language models.
Abstract
Pre-trained 3D vision-language models have demonstrated strong semantic generalization and robustness to distribution shifts. However, the implications of semantic robustness for geometric stability remain unclear. This study revisits the adversarial robustness of 3D vision-language models when confronted with adversarial point clouds. Focusing on zero-shot classification, this study demonstrates that these models exhibit heightened sensitivity to small coordinate perturbations. The behavior of adversarial perturbations is further analyzed under widely used point-cloud preprocessing mechanisms, revealing that naive filtering or reconstruction mainly suppresses irregular perturbations produced by vanilla gradient-based attacks and provides limited protection against stronger attack methods. To this end, a refined adversarial objective is introduced with two complementary priors that encourage adversarial point clouds to remain smooth and geometrically plausible: a statistical prior that regularizes the sampling distribution, and a geometric prior that promotes consistency with a plausible object-surface manifold. These findings highlight the need for a more rigorous security evaluation of 3D vision-language models.
The recent progress in the vision-language model (VLM) research made it one of the key aspects of artificial intelligence due to joint vision and language processing capabilities required for such tasks as image retrieval, visual question answering, autonomous systems and medical image analysis. However, despite the ex...
Kumari Anjali, Karnatakam Veda Sahithi, Sakinala Jyotsna· 2026 4th International Confe...· 0 citations
Theoretical analysis shows that under this anisotropic structure, adversarial attacks increase the expected geometric separation between clean and adversarial examples (AEs), and proposes GeoDetect, which leverages these off-manifold deviations via geometric scores to identify AEs.
Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie et al.· arXiv.org· 0 citations
This work proposes a white-box spectral-subspace-guided attack (SSGRA) that aligns intermediate representations with the subspace spanned by the bottom right singular vectors, offering a spectral interpretation of adversarial vulnerability in VLMs, providing insights for improving their robustness.
Chethan Krishnamurthy Ramanaik, Tobias Callies, Michael Hecht et al.· 0 citations
This work proposes RITA, a Robust test-tIme prompt-TAdaptation framework that shifts from sample-level estimates to distribution-level alignment, and employs optimal transport to align the distribution of augmented visual features with textual prototypes, mitigating adversarial outliers and rectifying cross-modal seman...
Xingyu Zhu, Huanshen Wu, Shuo Wang et al.· 1 citation
This work proposes the first diffusion-based unrestricted adversarial attack against 2D range-image segmentation, using adversarial guidance from a segmentation loss, and offers a distinct effectiveness-realism trade-off, achieving controllable white-box and transfer degradation while maintaining competitive distributi...
Stavros Bouras, Antonios Makris, A. Gkillas et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.