This paper proposes MobileDreamer, an efficient world-model-based lookahead framework to equip the GUI agents based on the future imagination provided by the world model, which consists of textual sketch world model and rollout imagination for GUI agent.
Patch Reparameterization is introduced, which preserves the original semantic pathway while adding a reconstruction-aware patch embedding that provides fine-grained visual information to the same frozen ViT blocks, and preserves multimodal understanding while enabling high-fidelity image reconstruction and a favorable...
Jinbo Yan, Limeng Qiao, Jie Qin et al.· 0 citations
Through an exhaustive evaluation of over 20 state-of-the-art MLLMs, HoloCount reveals a critical performance gap: even top-tier models degrade significantly as tasks transition from perception to complex analytical reasoning and adverse scenarios.