LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
LightCrafter, a hybrid pipeline that reformulates video relighting as video translation of a proxy video, bakes illumination targets into the PBR proxy, removing the need to teach the diffusion model illumination concepts like environment maps, and enables more intricate lighting control while naturally providing long-form temporal consistency.