Skip to content

ZoomDiff: A High-Fidelity Diffusion Model for Dual-Camera Smooth Zooming

Sep 2026 · arXiv.org · Vol abs/2609.28083 · 0 citations · 35 references
Computer Science

TL;DR

ZoomDiff is proposed, a high-fidelity diffusion model that leverages dual-camera inputs in both latent and pixel spaces for photo-realistic transitions that outperforms state-of-the-art methods quantitatively and qualitatively.

Abstract

Digital zoom transitions between dual cameras often exhibit conspicuous discontinuities in geometric structure and chromatic consistency, degrading the user experience. While recent dual-camera smooth zoom (DCSZ) methods attempt to mitigate this by fine-tuning frame interpolation (FI) models on DCSZ data, they struggle with the large cross-view disparities and complex geometric transformations. Considering that the generative prior of diffusion models is suitable for addressing this problem, we explore their application to DCSZ. However, naively applying existing diffusion-based FI models still yields low-fidelity transitions due to insufficient conditional guidance, high-frequency information loss during VAE encoding, as well as inadequate temporal consistency. To address this, we propose ZoomDiff, a high-fidelity diffusion model that leverages dual-camera inputs in both latent and pixel spaces for photo-realistic transitions. Specifically, we first strengthen dual-image conditional guidance during the multi-step denoising process to improve geometric consistency. Then we inject flow-aligned multi-scale features from the VAE encoder into the VAE decoder to recover high-frequency details, where flow-guided temporal consistency supervision are introduced to produce more smooth transitions. Extensive experiments on both synthetic and real-world datasets demonstrate that ZoomDiff outperforms state-of-the-art methods quantitatively and qualitatively. Project page: https://jiayi-hit.github.io/ZoomDiff.github.io/.

View source

Similar papers

Preprint Aug 2026

GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

This work proposes a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction and introduces a camera-conditioned geometric prior that guides the network toward geometrically grounded restoration that remains coherent across viewpoints.

Xinhui Liu, Can Wang, Wei Jiang et al. · 1 citation
#diffusion models Preprint Sep 2026

SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination

This work introduces an exact analytical pixel-to-texel mapping that aligns diffusion trajectories across multiple viewpoints, and utilizes High-Resolution Latent Textures as a persistent canvas for gradually denoised textures, while camera views perform the denoising steps in latent pixel space.

Athanasios Tragakis, M. Aversa, D. Ivanova et al. · 0 citations
Oct 2026

Ultra-High-Definition Image Restoration via Prior-driven Patch Bilateral Compensation

This work proposes Prior-driven Patch-based Bilateral Compensation (P2BiC), a memory-efficient UHD restoration framework that processes UHD images as patches via an in-network feature-space cropping computation path while maintaining global coherence.

Ze-Yu Xiao, Yang Zhao, Yu Liu et al. · 0 citations
Conference Open access Aug 2026

Uncertainty-Guided Latent Diffusion Models for Faithful Super Resolution

UGDiff, a novel diffusion guidance paradigm designed to further improve the perception-distortion balance, is introduced, which first estimates the reconstruction uncertainty of the latent features corresponding to a high-fidelity image and guides the diffusion process to selectively restore high-frequency details in h...

Ren Wang, Yung-Yu Chuang · 0 citations

Spatial Prior-guided Video Diffusion Models With Controllable Camera Trajectories

This work introduces additional 3D spatial prior information into both the training and inference stages of video diffusion models to enhance the spatial structural consistency of generated videos and introduces an energy-function guidance strategy (Warp-Guidance) driven by warping priors during denoising.

Hong-Zhou Zhu, Xue Yang, Min Zhao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.