Aug 2026· Computer graphics forum (Print)· 0 citations· 65 references
TL;DR
This paper presents a comprehensive review of inverse rendering methods published between 2020 and 2025, using a structured taxonomy that categorizes methods by input and output representations, computational strategies, and evaluation protocols.
Abstract
Inverse rendering is the problem of recovering scene geometry, material properties, and illumination from one or more observed images. It has experienced rapid progress in recent years, driven by advances in differentiable rendering, neural scene representations, and generative priors. This paper presents a comprehensive review of inverse rendering methods published between 2020 and 2025. In contrast to prior surveys on neural rendering, which review methods primarily focused on novel‐view synthesis without explicit material and lighting decomposition, and intrinsic image decomposition surveys, which review approaches for reflectance and shading separation at the image level, we focus on methods that aim to solve the complete inverse rendering problem. We organize the surveyed approaches using a structured taxonomy that categorizes methods by input and output representations, computational strategies, and evaluation protocols. We further analyze commonly used datasets, evaluation strategies, and performance trade‐offs, and discuss the strengths and limitations of existing approaches in terms of accuracy, efficiency, and generalization. Finally, we identify open challenges, including the ill‐posed nature of material and illumination disentanglement, the lack of standardized benchmarks for joint evaluation, and the limited exploration of downstream applications such as relighting and scene editing.
4D scene reconstruction aims to recover the evolving geometry, appearance, and motion of dynamic environments from visual observations. Despite substantial progress in neural scene representations, reconstructing dynamic scenes remains challenging due to non-rigid motion, occlusions, temporal inconsistencies, and the t...
Zi-Ren Gong, Guo Chen, Yong-Jian Li et al.· 1 citation
Inverse rendering decomposes a scene into geometry, materials, and lighting to enable physically consistent view synthesis and relighting. Inverse rendering approaches built upon Gaussian Splatting benefit from its efficient reconstruction pipeline, yet they struggle in the presence of strong shadows. Shadows are often...
Kotoka Matsunaga, Xue-Ning Tian, Hideo Saito et al.· IEEE Open Journal of Signal...· 0 citations
A fundamental limitation of classical rendering pipelines is that their discrete, non-differentiable structure makes them unsuitable for gradient-based parameter recovery. This paper presents a differentiable ray tracing framework that directly addresses this gap, enabling end-to-end optimization of object appearance,...
Akhil Veluru· International Journal of Int...· 0 citations
Recovering geometry, materials, and lighting from photographs is highly ambiguous when only static illumination is available. Active-lighting setups reduce the ambiguity but require dark rooms or specialized hardware. Instead, we synergize both static and flash lighting from casual indoor capture, with the flash on or...
Jia-Min Xu, Dong-Heng Wei, Jia-Rong Zhao et al.· 0 citations
This paper proposes a method that introduces an anchor re-growing module that dynamically increases neural Gaussian density in high-gradient regions using edge-aware optimization, and the Segment Anything Model (SAM) for generating accurate object segmentation masks to guide segmentation-based loss computation.
Meng-Yi Wang, Beiqi Chen, Niansheng Liu et al.· Signal, Image and Video Proc...· 0 citations
Image diffusion models have shown impressive image generation capabilities but are often hard to control, in contrast to classical computer graphics pipelines such as physically based rendering. However, we observe that there is a bridge between light transport phenomena and the distribution of latent space values prod...
V. Radovanović, Vishesh Gupta, Adrien Gruson et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.