Mixture of Layers: Dynamic Layer Routing for Visual Reasoning
Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local details. However, most Multimodal Large Language Models (MLLMs) rely on only the final or penultimate vision encoder representations or fixed aggregation rules, making...
Jeonghwan Kim, S. Stoica, Ji-Wan Chung et al.
· 0 citations