Multimodal Large Language Models (MLLMs) suffer from hallucinations, creating a critical need for Uncertainty Quantification (UQ) to ensure reliable deployment. However, existing approaches struggle to detect uncertainty caused by superficial associations, especially when the query-relevant signal is weak. We mainly at...
Hao-Yang Luo, Lin-Wei Tao, Jie Gui et al.· 0 citations
GPT-Policy is introduced, a general-agent framework for in-context robot learning that integrates a context compiler that preserves task-relevant visual transitions, a VLM that proposes robot-tool actions, and a constrained controller that verifies and executes each action and reports its outcome.
Dong-Zhou Cheng, Taoran Yi, Ye Fang et al.· 6 citations· ⚡3
The Modality Masking Mechanism (M3), an embarrassingly simple, training-only strategy that requires no architectural changes or large-scale robot pretraining, is introduced to improve robustness of query-based VLA policies for bimanual manipulation.
Dong-Zhou Cheng, Ziang Li, Yixiao Zhou et al.· 1 citation
Inspired by Bayesian posterior inference, this work reformulate backdoor detection as a representation-conditioned image likelihood estimation problem parameterized by a conditional diffusion generative model, and fine-tune a pretrained diffusion model, leveraging its generative prior to map data onto the natural image...
Tuo Chen, Jie Gui, Min-Jing Dong et al.· 0 citations
A new attack-agnostic, model-agnostic, and modality-agnostic black-box test-time defense paradigm, inspired by the Platonic Representation Hypothesis, that can perform both representation detection and purification, and achieves substantial performance gains across multiple attacks.
Tuo Chen, Minjing Dong, Benlei Cui et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.