Diffusion models have achieved remarkable success in image super-resolution (SR) by leveraging strong generative priors to enhance perceptual quality. However, for textual content, these priors often produce text hallucinations: non-existent or distorted text, which alter scene semantics and compromise model reliability. While recent methods focus on enhancing text generation, they do so indiscriminately, leaving hallucinations fundamentally unresolved. We argue the core problem is a lack of selective control. Therefore, we reformulate text SR as a selective generation problem: text is resolved only when reliable generation is expected, while other scene content is fully super-resolved. We introduce TGSR (Text-Grounded Super-Resolution), a test-time framework that progressively identifies and suppresses likely hallucinated text regions during generation. To enable this, we train dedicated detectors on a large-scale dataset curated from diverse diffusion-based SR outputs. TGSR consistently improves text fidelity across multiple backbones, increasing recognition precision by up to 17.68 points without degrading perceptual quality, underscoring the value of selective control in generative SR.
TOLA is proposed, a Text-aware One-step Latent Adaptation framework without iterative image-text diffusion that consistently surpasses existing diffusion-based TSR methods by at least 2.72 dB in PSNR on CTR-TSR-Test.
This work proposes a subject clarity outpainting framework that combines vision-language model (VLM)-guided semantic conditioning with multiscale wavelet supervision for subject-localized detail preservation and develops a subject-centric data curation pipeline that constructs subject-intersecting outpainting pairs fro...
Abhilash Neog, Taewan Kim, Yi Wu et al.· 0 citations
This study proposes DNF-SR, a dual-input and Negative-aware Feature fine-tuning method for Real-ISR that uses a dual-input strategy that concatenates the original LR image with the noisy LR input and feeds them into a diffusion-based image editing model, ensuring both high-fidelity one-step super-resolution and improve...
Shu-Hao Han, Wen-Jie Liao, Hayden Vance et al.· 1 citation
ConsistDiff is proposed, an inference-time optimization framework that enhances Stable Diffusion without requiring computationally expensive fine-tuning and consistently improves semantic alignment between the input text prompts and the generated images while maintaining highly efficient inference.
Jun-Wei Wang, Kai-Bing Zhang, Peng-Fang Li et al.· Neural Networks· 0 citations
RefMover is introduced, a multi-instruction diffusion framework for SIRR that bridges the semantic-spatial gap by combining language and region guidance and features a pipeline with a streamlined conditional architecture that mitigates condition conflicts and preserves details.
Zi-Feng Wang, Yuchen Hong, Tian-Yi Xu et al.· IEEE Transactions on Pattern...· 0 citations
Generated images often have coherent layouts and visual content, yet local errors in small text and complex characters still limit their readability and practical use. Scene-text refinement requires accuracy, preservation, and efficiency. Existing methods based on variational autoencoders (VAEs) can lose fine strokes d...
Yao-Li Liu, G. Wang, Yi-Yang Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.