This work introduces SON-1K, a comprehensive benchmark for text-to-image generation, and proposes a new approach, the enhanced LMDpp, enhancing the performance of the novel two-stage Large Language Model (LLM)-grounded diffusion model pipeline (LMD).
A scalable evaluation framework for simile understanding is proposed that includes a controlled simile dataset in which metaphorical vehicles are drawn from a predefined set of object-detectable categories and combined with diverse templates.
Luecheng Wang, Shintaro Ozaki, Hidetaka Kamigaito et al.· 0 citations
A comprehensive external and internal investigation of multimodal in-context learning on the image captioning task is conducted, revealing both how ICEs configuration strategies impact model performance through external experiments and characteristic typical patterns through internal inspection.
Li Li, Yongliang Wu, Jingze Zhu et al.· IEEE Transactions on Pattern...· 0 citations
VLTok is a novel 1D hybrid tokenizer that unifies V isual and L anguage representations in a shared Tok en space through a self-prompted training paradigm, and achieves state-of-the-art performance in both image reconstruction and image generation.
Hualiang Wang, Siming Fu, Wei-Nan Jia et al.· 0 citations
It is shown that VQA can serve as an effective semantic feedback to significantly enhance prompt-image alignment without retraining the diffusion model, providing a powerful, interpretable and self-correcting strategy for text-to-image production.
DynEval, a Dynamic Evaluation framework designed to jointly assess text-to-image alignment and image quality of T2I models, is introduced and a compact evaluator achieves a higher overall correlation with human judgments.
Shyam Marjit, Dheeraj Baiju, Anuj Shikarkhane et al.· 0 citations
Understanding newspaper images remains a challenging task due to their complex, nested hierarchical structures and dense, heterogeneous layouts. In this paper, we explore two complementary approaches for newspaper structure understanding. First, we present a modular bottom-up pipeline that combines state-of-the-art ope...
William Mocaër, Solène Tarride, Thomas Constum et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.