Pathways of Visual Information Flow in Vision-Language Models
Across three visual tasks, it is shown that pathway selection is task-dependent, and that data distribution and prompt design can also modulate which pathway is used to solve the image-based query.