Skip to content
Open access

Revisiting Adversarial Robustness in Large-Scale 3-D Vision–Language Models

2026 · IEEE Access · Vol 14, pp. 106903-106916 · 0 citations · 52 references
Computer Science

TL;DR

Focusing on zero-shot classification, this study demonstrates that 3D vision-language models exhibit heightened sensitivity to small coordinate perturbations, highlighting the need for a more rigorous security evaluation of 3D vision-language models.

Abstract

Pre-trained 3D vision-language models have demonstrated strong semantic generalization and robustness to distribution shifts. However, the implications of semantic robustness for geometric stability remain unclear. This study revisits the adversarial robustness of 3D vision-language models when confronted with adversarial point clouds. Focusing on zero-shot classification, this study demonstrates that these models exhibit heightened sensitivity to small coordinate perturbations. The behavior of adversarial perturbations is further analyzed under widely used point-cloud preprocessing mechanisms, revealing that naive filtering or reconstruction mainly suppresses irregular perturbations produced by vanilla gradient-based attacks and provides limited protection against stronger attack methods. To this end, a refined adversarial objective is introduced with two complementary priors that encourage adversarial point clouds to remain smooth and geometrically plausible: a statistical prior that regularizes the sampling distribution, and a geometric prior that promotes consistency with a plausible object-surface manifold. These findings highlight the need for a more rigorous security evaluation of 3D vision-language models.

Read PDF

Similar papers

Conference Jul 2026

Adversarial Robustness in Large Vision-Language Models

The recent progress in the vision-language model (VLM) research made it one of the key aspects of artificial intelligence due to joint vision and language processing capabilities required for such tasks as image retrieval, visual question answering, autonomous systems and medical image analysis. However, despite the ex...

Kumari Anjali, Karnatakam Veda Sahithi, Sakinala Jyotsna · 0 citations
Jul 2026

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks. Existing defense methods predominantly target single-task scenarios (e.g., zero-shot classification) an...

Sibo Wang, Jie Zhang, Shiguang Shan et al. · 0 citations
Jul 2026

GeoDetect: Geometric Adversarial Detection for VLPs

Theoretical analysis shows that under this anisotropic structure, adversarial attacks increase the expected geometric separation between clean and adversarial examples (AEs), and proposes GeoDetect, which leverages these off-manifold deviations via geometric scores to identify AEs.

Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie et al. · 0 citations
Preprint Jul 2026

On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspaces

This work proposes a white-box spectral-subspace-guided attack (SSGRA) that aligns intermediate representations with the subspace spanned by the bottom right singular vectors, offering a spectral interpretation of adversarial vulnerability in VLMs, providing insights for improving their robustness.

Chethan Krishnamurthy Ramanaik, Tobias Callies, Michael Hecht et al. · 0 citations
Preprint Jul 2026

Robustifying Vision-Language Models via Test-Time Prompt Adaptation

This work proposes RITA, a Robust test-tIme prompt-TAdaptation framework that shifts from sample-level estimates to distribution-level alignment, and employs optimal transport to align the distribution of augmented visual features with textual prototypes, mitigating adversarial outliers and rectifying cross-modal seman...

Xingyu Zhu, Huanshen Wu, Shuo Wang et al. · 1 citation
Preprint Jul 2026

Adversarially Guided Diffusion for LiDAR Range Image Synthesis

This work proposes the first diffusion-based unrestricted adversarial attack against 2D range-image segmentation, using adversarial guidance from a segmentation loss, and offers a distinct effectiveness-realism trade-off, achieving controllable white-box and transfer degradation while maintaining competitive distributi...

Stavros Bouras, Antonios Makris, A. Gkillas et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.