E-WAVE is presented, a correlation-free framework for high-temporal-resolution (HTR) optical flow estimation from event streams that employs global attention mechanism to model long-range feature dependencies and performs trajectory guided feature warping using B\'ezier curve.
Abstract
Temporally dense optical flow is essential for dynamic perception in immersive VR/AR systems, where rapid head, hand, and object motion must be continuously captured and tracked. Existing frame-based optical flow estimation methods are constrained by the tradeoff between temporal resolution and computational cost; while event cameras, with their high temporal resolution and energy efficiency, serve as a natural solution to the dilemma. However, event-based approaches commonly rely on correlation volumes to capture pairwise voxel correspondences, which incur substantial memory and computation overhead. We present E-WAVE, a correlation-free framework for high-temporal-resolution (HTR) optical flow estimation from event streams. Instead of constructing all-pairs correlation volumes, E-WAVE employs global attention mechanism to model long-range feature dependencies and performs trajectory guided feature warping using B\'ezier curve. Through iterative updates, it predicts trajectories that allow for querying at arbitrary timestamps without repeated inference. Experiments on MultiFlow and DSEC-Flow demonstrate a 25% lower trajectory error and comparable endpoint flow estimation accuracy relative to state-of-the art baselines. Additional evaluations on self-captured data using a head-mounted prototype validate that E-WAVE remains robust under challenging real-world conditions.
This paper introduces a spatio-temporal registration framework to increase accuracy of current state-of-the-art event-by-event flow estimation, while also introducing a twofold algorithm acceleration approach and a real-time implementation strategy to mitigate the impact of computation scaling with event rate.
Zhi-Chao Li, Arren J. Glover, Lorenzo Natale et al.· IEEE Transactions on Pattern...· 0 citations
Visual odometry (VO) estimates camera motion from image sequences and is essential for robotics, autonomous driving, and AR/VR. Robust VO remains challenging because large viewpoint changes and strong parallax make reliable cross-frame motion cues difficult to capture, especially in the presence of visual disturbances...
Jun-Qi Bao, Qing-Ying Wu, Jun Huang et al.· IEEE Transactions on Instrum...· 0 citations
Oriented Distance Field Motion Estimation (ODF Motion Estimation), which replaces this optimization with a single averaging step over a precomputed field of event distance vectors, combined with an adaptive event-count selection strategy and a parameter-free trail filter, reaches sub-pixel accuracy at the lowest latenc...
This work fundamentally reimagines motion blur handling through a paradigm shift: rather than removing blur artifacts, the challenge is reformulate the challenge as a well-constrained forward problem that generatively models blur formation within the rendering pipeline.
Event cameras asynchronously report brightness changes with high temporal resolution and wide dynamic range, but background activity (BA) noise corrupts the sparse structures used by downstream perception. Conventional training-free filters primarily measure local support in observed coordinates, where fast motion can...
Jun-Cheng Li, Xu-Liang Zhu, Zhan Sun et al.· IEEE Sensors Journal· 0 citations
Pretrained video foundation models encode rich semantic and spatiotemporal priors for embodied navigation, yet converting these priors into UAV motion typically requires expensive future-video synthesis and geometric reconstruction. We investigate whether the motion implicit in future visual prediction can instead be r...
Morui Zhu, Yu-Ze Wu, Xi-Jie Huang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.