Skip to content
#diffusion models Conference Open access

AI-Driven 3D/4D Content Generation, Editing, and Animation Using Diffusion Models and Gaussian Splatting: A Narrative Review

Sep 2026 · Exploring Science Academic Conference Series · 0 citations · 28 references
Generative Adversarial Networks and Image Synthesis

TL;DR

This narrative review syn thesizes representative works published between 2023 and 2025 across four interconnected sub-areas: text-to-3D/4D generation, 3D scene editing, dynamic scene animation, and motion and video generation.

Abstract

The convergence of diffusion models and 3D Gaussian Splatting (3D -GS) has catalyzed a paradigm shift in AI-driven 3D/4D content creation, enabling high-quality generation, editing, and animation from natural language instructions. This narrative review syn thesizes representative works published between 2023 and 2025 across four interconnected sub-areas: text-to-3D/4D generation, 3D scene editing, dynamic scene animation, and motion and video generation. Through comparative analysis of representation types, supervision strategies, and temporal modeling approaches, we identify convergent design principles—coarse- to-fine optimization in distillation-based methods, explicit representations, regularization against score - distillation variance, and decomposition for controllability—that recur across sub-areas. We catalog six critical limitations and propose concrete directions for improvement for each. This review serves as a foundational reference for researchers entering this rapidly evolving field.

Read PDF

Similar papers

Apr 2026

AnimateAnyMesh++: A Flexible Feed-Forward Framework for High-Fidelity Text-Driven Mesh Animation.

AnimateAnyMesh++ is presented, a feed-forward framework for text-driven animation of arbitrary 3D meshes with substantial upgrades in data, architecture, and generative capability, and demonstrates that AnimateAnyMesh++ generates semantically accurate and tem porally coherent mesh animations within seconds, surpassing...

Zijie Wu, Chao-Hui Yu, Fan Wang et al. · 3 citations · ⚡1
Oct 2026

Motion Controlled Text-to-4D Generation with Multi-View Video Diffusion Model.

Recent advances in 2D and 3D generative modeling have paved the way for 4D generation. However, existing methods predominantly focus on text-to-4D generation, emphasizing temporal smoothness and spatial consistency while often neglecting precise motion control. Furthermore, due to the inherent ambiguity of text descrip...

Run-Xin Liu, Yang Chen, Ying-Wei Pan et al. · 0 citations
Open access Aug 2026

Text-to-hierarchical three-dimensional scene generation: a new approach for layered three-dimensional modeling from natural language

An end-to-end hierarchical framework for text-to-3D scene generation that synergistically integrates state-of-the-art components for video synthesis and mesh reconstruction is introduced, offering a powerful solution for applications, such as virtual reality and digital twins.

Zuan Gu, Tian-Han Gao, Lang-Xu Zhao et al. · 0 citations
Open access Aug 2026

SPL4SH: Designing a Systematic Pipeline for 4D Synthetic Humans in XR Content Creation

SPL4SH contributes a grounded framework for selecting, combining, and evaluating independent generative components as XR-ready synthetic human assets and shows that modular 4D human generation is technically feasible.

David Ohara de Souza Cardoso, Willams de Lima Costa, Pedro Azevedo Abrantes de Oliveira et al. · 0 citations
Sep 2026

MeshSeqGen: Zero-shot Mesh Animation based on a Large Video Generation Model.

MeshSeqGen is introduced, a zero-shot framework that simplifies this process by using the motions from generated video frames to guide mesh deformation, and its mesh-based Gaussian representation ensures the final animations are both plausible and structurally consistent.

Yun-Peng Xiao, Jie Yang, Chuan Li et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.