Skip to content

SON: Enhancing Prompt Understanding of Diffusion Models with Large Language Models Guided Layouts

· 0 citations · 33 references

TL;DR

This work introduces SON-1K, a comprehensive benchmark for text-to-image generation, and proposes a new approach, the enhanced LMDpp, enhancing the performance of the novel two-stage Large Language Model (LLM)-grounded diffusion model pipeline (LMD).

View source

Similar papers

Preprint Aug 2026

Simile Understanding in Text-to-Image Models: An Evaluation Framework

A scalable evaluation framework for simile understanding is proposed that includes a controlled simile dataset in which metaphorical vehicles are drawn from a predefined set of object-detectable categories and combined with diverse templates.

Luecheng Wang, Shintaro Ozaki, Hidetaka Kamigaito et al. · 0 citations
Jul 2026

Unveiling Effective In-Context Configurations for Image Captioning: An External & Internal Analysis.

A comprehensive external and internal investigation of multimodal in-context learning on the image captioning task is conducted, revealing both how ICEs configuration strategies impact model performance through external experiments and characteristic typical patterns through internal inspection.

Li Li, Yongliang Wu, Jingze Zhu et al. · 0 citations

Prompt Yourself: Awakening Textual Semantics in 1D Visual Tokenizers

VLTok is a novel 1D hybrid tokenizer that unifies V isual and L anguage representations in a shared Tok en space through a self-prompted training paradigm, and achieves state-of-the-art performance in both image reconstruction and image generation.

Hualiang Wang, Siming Fu, Wei-Nan Jia et al. · 0 citations
Open access 2026

VQA-Guided Diffusion: Enhancing Text-to-Image Generation With Semantic Feedback From Visual Question Answering

It is shown that VQA can serve as an effective semantic feedback to significantly enhance prompt-image alignment without retraining the diffusion model, providing a powerful, interpretable and self-correcting strategy for text-to-image production.

Debashish Bhowmik, Ishika Maity, Ashis Kumar Pati · 0 citations
Preprint Jul 2026

DynEval: Holistic Evaluations of T2I Generative Models in the Wild

DynEval, a Dynamic Evaluation framework designed to jointly assess text-to-image alignment and image quality of T2I models, is introduced and a compact evaluator achieves a higher overall correlation with human judgments.

Shyam Marjit, Dheeraj Baiju, Anuj Shikarkhane et al. · 0 citations
Jul 2026

Towards Hierarchical Structure Understanding of Newspaper Images

Understanding newspaper images remains a challenging task due to their complex, nested hierarchical structures and dense, heterogeneous layouts. In this paper, we explore two complementary approaches for newspaper structure understanding. First, we present a modular bottom-up pipeline that combines state-of-the-art ope...

William Mocaër, Solène Tarride, Thomas Constum et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.