IP-ConTex: detail-consistent texture generation with image prompt
TL;DR
Experimental results demonstrate that IP-ConTex successfully transfers appearance details to 3D geometries without fine-tuning or optimization, thus achieving high-quality and detail-consistent texture generation.
Abstract
Textures are critical for enhancing the visual fidelity and diversity of three-dimensional (3D) models. Recently, generative models have significantly advanced texture generation. However, fine-grained control of the generation process remains challenging. Hence, we propose IP-ConTex, which is a novel image-guided texture-generation method that introduces appearance control into the diffusion process to ensure detail-consistent results. First, synchronized multiview diffusion is employed to maintain structural and layout consistency across multiple views. Subsequently, a new appearance-control module is designed for the pretrained diffusion model. By leveraging cross-attention control, self-attention control, diffusion feature synchronization, and color adjustment, appearance information from the reference image is effectively extracted and injected into the texture-generation process. Experimental results demonstrate that IP-ConTex successfully transfers appearance details to 3D geometries without fine-tuning or optimization, thus achieving high-quality and detail-consistent texture generation.