Evaluating state-of-the-art video generators, image generators, and LLM/VLM baselines reveals a sharp gap between visual quality and reasoning correctness: video models perform best on Physical Commonsense, but remain weak on symbolic tasks such as Sudoku, ARC, and Math, and brittle in cross-view embodied navigation.
Ze-Fan Cai, Haoyi Qiu, Tian-Yi Ma et al.· 9 citations· ⚡1
CLAMP is introduced, a multimodal constraint-grounding framework that turns scene evidence into decoding-time constraints for a frozen VLM planner that allows the planner to retain the VLM's language prior while preventing visually unsupported, unsafe, or infeasible candidates from entering the plan.
Meta-Ctrl is proposed, a constrained-decoding framework that guarantees the encoded constraints while preserving the base LM's plan quality, and is demonstrated on a real tabletop robot, where every generated plan satisfies its preconditions and goals by construction.
Gwen Yidou-Weng, Edward Sun, Tian-Yi Ma et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.