This work introduces MotionPhys, a lightweight and interpretable framework that treats sparse motion trajectories as physical evidence rather than relying on appearance artifacts or generator-specific traces and reveals subtle motion inconsistencies that are difficult to capture with conventional visual cues and transforms them into a compact representation for efficient detection.
Abstract
Modern AI video generation models can produce videos with high visual fidelity and seemingly smooth temporal transitions. However, visual realism does not necessarily imply physical motion consistency. Existing generative models mainly optimize distribution matching in pixel or latent spaces, without explicitly enforcing real-world constraints such as inertia, continuous forces, and trajectory geometry. Our experiments show that AI-generated videos remain visually plausible over short sequences of consecutive frames, yet fail to preserve physical motion consistency throughout a complete object action, resulting in systematic statistical discrepancies in their motion trajectories. Based on this observation, we introduce MotionPhys, a lightweight and interpretable framework that treats sparse motion trajectories as physical evidence rather than relying on appearance artifacts or generator-specific traces. By modeling the geometric evolution of trajectories across multiple temporal scales, MotionPhys reveals subtle motion inconsistencies that are difficult to capture with conventional visual cues and transforms them into a compact representation for efficient detection. Experiments on multiple datasets show that MotionPhys can effectively detect physical inconsistencies in generated videos and generalizes well across different video generators.
It is argued that recent progress in video understanding is measured by benchmarks and protocols that can be solved without reliably perceiving spatiotemporal evidence, rewarding language-driven plausibility over video-grounded inference.
Shayda Moezzi, Umer Saleem, Andong Deng et al.· 1 citation
DeforM is proposed, a reasoning-guided image-to-video generation framework that directs the model's focus toward physics-critical regions, and introduces a VLM-guided physical reasoning module, DeforM-Reason, to identify target objects and generate spatial-temporal masks.
Yunyi Li, Yu Qiao, Yaohui Wang et al.· 0 citations
UniMoCa, a representation-driven framework that unifies motion and camera controls in visual space, achieves substantial gains in human motion control, camera control, temporal consistency, and camera-aware robustness with minimal additional complexity.
Liming Tan, Ye Chen, Hao Zhang et al.· 0 citations
The Structured Dynamics Model (SDM) is proposed, which explicitly separates the dominant source of temporal change from residual dynamics through future-feature prediction, rather than representing video change with a single entangled latent or with unstructured, spatially dense transition tokens.
Lukas Knobel, Andrew Zisserman, Yuki M. Asano· 0 citations
Geometry-Aware Motion Latents is introduced, which learns discrete motion latent codes by predicting how point clouds evolve during manipulation rather than reconstructing visual observations, demonstrating that effective motion latents for robot control can better emerge from understanding motion through its three-dim...
Yunchao Zhang, Yijia Weng, Ruizhe Liu et al.· arXiv.org· 0 citations
This paper analyzes two features used in event-based corner detection---the eigenvalues of the structure tensor and the spatiotemporal density values---and shows that they are motion cues, and hypothesize that these features, combined with local geometric information, can enhance motion estimation tasks.
Hesam Araghi, J. V. van Gemert, Nergis Tomen· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 15, 2026
AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post Building trustworthy AI: The role of AI harnesses, intent contracts and evals appeared first on GPT-Lab.
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.