Learning Video Dynamics with Predictive Differentiable Rendering
Inspired by recent progress in 3D reconstruction with 3D Gaussian Splatting, PredGS, a lightweight and plug-and-play adapter based on 2D Gaussian representation, which could be seamlessly integrated with existing pixel space predictors, significantly improving spatial detail preservation with negligible computational o...