Skip to content
Preprint

Towards Physics-Faithful Generation of Scientific Diagrams

Aug 2026 · 0 citations
Computer Science

TL;DR

Princigram shows that explicit physics-structured supervision improves the physical faithfulness of generated scientific diagrams, and curate and structurally annotate 4.3 million physics images, carry expert-level annotation, and adapt a unified multimodal backbone.

Abstract

Text-to-image generation has reached photorealistic quality, yet state-of-the-art systems remain unreliable at producing scientific diagrams, whose value depends not on appearance but on physical faithfulness: correct force directions, valid coordinate systems, consistent thermodynamic states, and equations matching the depicted scenario. Trained on web imagery with physically shallow captions, generic models produce diagrams that look plausible but are physically wrong, harmful in education and scientific communication. We present Princigram, a physics-faithful scientific-diagram generator, and its data pipeline. Our central advance is Structured Physical Chain-of-Thought (SP-CoT): a per-subdiscipline schema that decomposes a physics diagram into an explicit multi-step reasoning chain across six subdisciplines, from scene identification through force or process analysis to governing laws and synthesis. Unlike free-form chain-of-thought, SP-CoT follows a fixed schema with strict fidelity rules that separate visually grounded facts from physically inferred reasoning and type all mathematics symbolically; it serves both as dense training supervision and, at inference, as a structured"thinking"prompt. With it we curate and structurally annotate 4.3 million physics images, of which 115,037 carry expert-level annotation, and adapt a unified multimodal backbone. We further introduce VeriphyT2IBench, whose questions are derived from each held-out diagram's own structured annotation: each diagram becomes an item-specific bank of binary questions about its objects, forces, and states, so a judge model's score decomposes into named physical facts rather than one holistic number. On the physics subset of GenExam and on VeriphyT2IBench, Princigram shows that explicit physics-structured supervision improves the physical faithfulness of generated scientific diagrams.

View source

Similar papers

Preprint Sep 2026

Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation

This work introduces RIG-BENCH, a novel comprehensive benchmark that systematically evaluates Reasoning-driven Image Generation (RIG) across four cognitively demanding domains: Concept-based, Transformation-based, Pattern&Structure, and Scenario-based.

Yu-Tong Liu, Nan Huang, Xu Cao et al. · 1 citation
#artificial intelligence Preprint Sep 2026

PhysMAS: Physics-Grounded Multi-Agent Synthesis of Compositional 4D Gaussians

Efficient, fully automatic, and physically plausible 4D Gaussian synthesis is an important goal for dynamic scene generation. Recent physics-based methods couple 3D Gaussians with the Material Point Method (MPM) to generate physically driven motion, but extending this paradigm to heterogeneous multi-part objects and in...

Jiang Qin, Chun-Ji Lv, Yang-Guang Wei et al. · 0 citations
Preprint Aug 2026

NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation

NeoWorld-Pro is proposed, a framework that reformulates monocular scene reconstruction as procedural programming for interactive 3D environments and outperforms open-loop and prior monocular reconstruction methods, while enabling complex downstream tasks such as stable stacking and fine-grained manipulation.

Yu-Meng He, Eachen Soong, Xiao-Tian Yang et al. · 1 citation
Preprint Sep 2026

Principia: Relational Physics Tests for Video Models

This work introduces Principia, a benchmark that evaluates Newtonian physics through relational consistency between paired objects, and introduces a calibration-independent consistency score that quantifies physical violation directly in image space.

Varun Varma Thozhiyoor, Shivam Tripathi, Venkatesh Babu Radhakrishnan et al. · 3 citations · ⚡1
Preprint Sep 2026

Physics as the label for measuring and correcting materials reasoning in multimodal models

MatPCR is introduced, a label-free benchmark whose programmatic oracles check diffraction geometry through Bragg's law, scale bars, spectral peaks, and Materials Project-grounded checks of near-hull stability, computed band-gap class, and net magnetization.

Hasan Kurban, Rasul Khanbayov, Mustafa Kurban · 0 citations
Preprint Sep 2026

SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

SciGen-Verifier is constructed, a reasoning-driven multimodal verifier trained via cold-start supervised fine-tuning followed by a curriculum-based two-stage reinforcement learning pipeline that achieves competitive performance against much larger proprietary models.

Jia-Li Chen, Zheng-Teng Lin, Zu-Qi Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.