Robustness of Internal Signals for Hallucination Detection in Vision-Language Models
This investigation reveals important limitations of the current methods that try to leverage internal VLM signals to detect hallucinations and suggests that strong detection performance is often driven by detecting language-based hallucinations, and when methods rely on token position, they tend to be less visually gro...
Allison Chen, William Yang, Salma Abdel Magid et al.
· 0 citations