Skip to content
Preprint

TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters

Aug 2026 · 1 citation · 41 references
Computer Science

TL;DR

Extensive experiments on both insertion and replacement demonstrate that TextRefine consistently outperforms the evaluated image editing baselines in textual fidelity, placement reliability, and glyph quality while better preserving source-image content.

Abstract

Text editing in product posters entails inserting new text or replacing existing text while preserving product appearance, background content, and global composition. Despite recent progress in instruction-based image editing, general-purpose models remain unreliable in this setting: they often omit or incorrectly render the target text, place it over salient products or pre-existing content, and produce structurally distorted or visually inconsistent glyphs. We introduce \textbf{TextRefine}, a task-aligned post-training framework that combines supervised fine-tuning with operation-specific reward optimization to address these complementary failure modes. For text insertion, our text-span-level reward jointly assesses semantic fidelity and target-span coverage, penalizes spatial conflicts with products and existing text, and employs a gated structural constraint to preserve non-text regions. For text replacement, our glyph-level reward leverages the connectionist temporal classification (CTC) posterior of the target character to provide graded supervision for fine-grained defects, including missing strokes, structural deformations, and confusion among visually similar characters. We further introduce \textbf{OpenTextEdit}, a dataset comprising 100K images for text editing in product posters, with multi-text layouts, detailed text attributes, product masks, and challenging low-frequency characters. Extensive experiments on both insertion and replacement demonstrate that TextRefine consistently outperforms the evaluated image editing baselines in textual fidelity, placement reliability, and glyph quality while better preserving source-image content.

View source

Similar papers

Preprint Sep 2026

GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors

Rendering accurate text remains difficult for image generation and editing models, especially when the target contains long, complex, and densely arranged text or rare characters. Existing approaches either improve native text rendering through stronger backbones and data-centric training without explicit glyph priors,...

Qiang Xiang, Shu'ang Sun, Bing-Lei Li et al. · 2 citations
Preprint Oct 2026

TextVBench: Evaluating Text Rendering and Preservation in Video Generation

TextVBench is introduced, a benchmark and evaluation framework that formulates visual-text evaluation as a multi-target, multi-instance spatiotemporal correspondence problem, and is organized around controlled text, layout, carrier, and motion attributes so that aggregate scores can be traced back to specific capabilit...

Rui-Qiang Zhang, Heng-Yi Wang, Chang Liu et al. · 0 citations
Preprint Sep 2026

Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering

Video text editing aims to replace or add text in a video while keeping the rest of the video unchanged, which requires the edited text to be correct in every frame and to move coherently with the scene. Despite the remarkable progress of video diffusion models, they struggle to reproduce exact stroke structures and of...

Shu-Lian Zhang, Xiang-Yu Shu, Wen-Bo Li et al. · 0 citations
Preprint Sep 2026

T2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation

Recent text-to-image models have become increasingly capable of rendering explicit text, but reliable localized text control requires more than generating the correct string. In applications such as product labeling, signage, and interface design, target text should be rendered within a designated text-bearing region w...

Yan Wang, Xin-Yi Hou, Wei-Guo Lin et al. · 1 citation
Preprint Sep 2026

Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation

A video can exhibit convincing motion and photorealism yet fail immediately when visual text collapses. Unlike generic scene content, visual text is unforgiving in video generation: minor stroke corruption, temporal instability, or editing errors instantly break legibility and realism. Existing benchmarks overlook this...

Zi-Ying Zhang, Li-Tao Li, Junchao Liao et al. · 0 citations
Preprint Sep 2026

Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation

Generating text-rich images from prompts requires both textual fidelity and the coherent integration of text into the surrounding image. An explicit layout can provide structured guidance about what text should appear and where, but a well-formed plan alone does not guarantee that the renderer will realize it faithfull...

Guan-Qiao Chen, Jing Tan, Dong-Xing Mao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.