Skip to content

Position: Video LLMs Must Not Ignore the Pixel Dynamics in Plain Sight

· 1 citation · 75 references

TL;DR

It is argued that recent progress in video understanding is measured by benchmarks and protocols that can be solved without reliably perceiving spatiotemporal evidence, rewarding language-driven plausibility over video-grounded inference.

View source

Similar papers

#computer vision Preprint Aug 2026

GlanceWAM: Sparse Test-Time Imagination for World-Action Models

GlanceWAM is introduced, which decouples imagination from control within a single video DiT: an asynchronous proposer glances ahead on a slow clock to imagine a single lookahead frame seconds into the future in the background, while an action head decodes action chunks at control rate purely in latent space without blo...

Lin-Han Wang, Zi-Jian An, Mingyuan Zhang et al. · 2 citations
#generative ai Preprint Aug 2026

MotionPhys: Detecting AI-Generated Videos via Physical Consistency of Optical-Flow Trajectories

This work introduces MotionPhys, a lightweight and interpretable framework that treats sparse motion trajectories as physical evidence rather than relying on appearance artifacts or generator-specific traces and reveals subtle motion inconsistencies that are difficult to capture with conventional visual cues and transf...

Hao He, Hao Tan, Zichang Tan et al. · 0 citations
#computer vision Preprint Aug 2026

What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

It is indicated that current VLMs can identify anomalies within individual frames but struggle to integrate information across frames to reason about temporal consistency, and TimeCatch provides a controlled benchmark for evaluating temporal grounding in vision-language models.

Marek Hradil, Danae Sánchez Villegas · 0 citations
Preprint Aug 2026

StreamFlow: Dynamic Memory Flows for Streaming Video Understanding

StreamFlow is introduced, an efficient visual memory framework that enables dynamic, on-demand access to historical visual information and improves the visual attention score while reducing end-to-end latency and peak memory, enabling more visually grounded and efficient reasoning.

Muxin Fu, Yifan Zhang, Wentao Zhang et al. · 0 citations
Jul 2026

Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratio

An inference-time adaptive guidance method is proposed, which exploits this intrinsic feature attention pattern to dynamically amplify compositional video conditioning signals precisely when the policy relies on future rollouts, and mitigates the OOD-ID compositional generalization gap.

U. A. Mishra, Yongxin Chen, Danfei Xu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.