This work proposes a subject clarity outpainting framework that combines vision-language model (VLM)-guided semantic conditioning with multiscale wavelet supervision for subject-localized detail preservation and develops a subject-centric data curation pipeline that constructs subject-intersecting outpainting pairs from advertising and natural images.
Abstract
Commercial and advertising images are frequently affected by poor framing, partially cropped subjects, truncated text or logos, and insufficient context, all of which can reduce subject clarity, i.e., the ability of an image to clearly communicate its primary subject. Image outpainting offers a scalable solution by extending image boundaries and recovering missing content and context. However, existing diffusion-based outpainting methods often produce visually plausible completions while degrading subject fidelity through structural inconsistencies, semantic drift, or loss of fine-grained detail. To address this limitation, we propose a subject clarity outpainting framework that combines vision-language model (VLM)-guided semantic conditioning with multiscale wavelet supervision for subject-localized detail preservation. To support training, we develop a subject-centric data curation pipeline that constructs subject-intersecting outpainting pairs from advertising and natural images. The resulting objective introduces no additional inference cost and is designed to be compatible with diffusion-based backbones. Across four advertising and natural-image benchmarks, our method improves subject clarity, reducing subject-centered DreamSim error and FID on average by 3.0% and 2.4% over matched supervised fine-tuning, and by 10.8% and 7.7% over the strongest state-of-the-art approach per dataset, respectively.
PixRestore is presented, a VAE-free pixel-space Diffusion Transformer (DiT) for UIR, where the diffusion backbone is trained entirely from scratch, without relying on T2I pretraining.
Ling-Chen Sun, Rong-Yuan Wu, Xiang-Tao Kong et al.· 2 citations
MagnifiQ is introduced, an image restoration framework that progressively upscales and restores images across resolutions, e.g., from 1024x1024 to 4096x4096, and leverages a pre-trained text-to-image diffusion model such as SDXL and adapts it for more scalable high-resolution inference by replacing its original self-at...
M. Reddy, Yashesh Savani, Antoine Mercier et al.· 0 citations
Experiments indicate that the proposed front end of Specific Object-of-Interest Imaging improves object-region reconstruction and boundary stability for several inpainting backbones, although the gains are not uniform across all metrics or categories.
Yong-Hao Wu, Rui-Rong Wang, Kang-Wen Wu et al.· Machine Vision and Applicati...· 0 citations
Adaptive Frequency-Aware Diffusion (AFID), an adaptive framework for high-quality text-guided image inpainting, is proposed and comprehensive comparisons against prevailing state-of-the-art inpainting approaches solidly confirm its superiority in visual fidelity, intact-area preservation and text-prompt consistency.
This work implements overpainting by adapting a pretrained image editing diffusion model using a combination of joint attention and low-rank adaption across input images with attention-dropout to balance the information flow between noise, source and mask images.
Sam Sartor, Iliyan Georgiev, Michael Fischer et al.· 2 citations
This paper proposes a zero-shot framework for constrained latent inpainting with a frozen pretrained Stable Diffusion model, requiring no task-specific training or model fine-tuning and demonstrates effective object removal and context-consistent replacement content.
Arman Taghizadeh, U. Krumnack, Kai-Uwe Kühnberger· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.