Vision-Language-Action (VLA) models have made substantial progress in robotic manipulation, but their generalization remains constrained by the diversity and coverage of action-labeled robot demonstrations. Human videos provide much broader behavioral and environmental experience, while learning from them faces a funda...
Chaehyun Kim, Chi-Pin Huang, Jisoo Kim et al.· 0 citations
This work introduces Ask4NV, a pretrained unified multimodal model with a Mixture-of-Transformers (MoT) architecture that incorporates camera geometry into both VAE and ViT representations and leverages understanding features during generation through joint self-attention with a modality-aware attention masking strateg...
Jahyeok Koo, Hyeonseo Yu, Seung-Ho Jang et al.· 0 citations
Reasoning about the 3D world from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While modern MLLMs handle single-image inputs effectively, they struggle to integrate evidence across viewpoints into a coherent 3D understanding. A growing body of work attempts to close th...
Jaewoo Jung, Hyeonseo Yu, Honggyu An et al.· 0 citations
This work empirically finds that transferability depends on architecture-models with fully shared transformer backbone and a unified visual encoder exhibit consistent cross-task transfer, while loosely coupled designs show little or none.
Jiwon Kang, Heeji Yoon, Jaewoo Jung et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.