World models offer a promising alternative to physics-based simulators, yet remain far from practical deployment. We ask how far scaling ego-centric human video takes them, using a dataset of 30,000 hours spanning over 1,000 scene types and 14,000 contributors. Rather than relying on opaque downstream metrics, we direc...
Jia-Hua Dong, Anurag Bagchi, Yash Jangir et al.· 0 citations
SALT is introduced, a Semantically ALigned action Tokenizer that augments a VQ-VAE-style tokenizer with an auxiliary objective requiring a frozen vision-language model to recover the episode instruction from quantized action latents to substantially improve language-conditioned control.
Wen-Jie Li, Yash Jangir, Ignacy Stepka et al.· 1 citation
This work studies how to learn anticipation of how objects move during human-object interaction from ordinary monocular videos of human-object interaction, and shows that it can efficiently re-purpose video priors into explicit geometric forecasts for embodied intelligence.