Skip to content
Preprint

UniMo: Unifying Human and Animal Motion Generation

Sep 2026 · 0 citations · 34 references
Computer Science

TL;DR

UniMo is proposed, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints.

Abstract

The conditional generation of 3D motion has emerged as a key research topic due to its wide applicability across robotics, AR/VR, gaming, and content creation. However, extending recent advances in text-driven human motion generation to the animal domain remains challenging due to two core limitations. First, animals exhibit highly diverse skeletal topologies, unlike the standard human structure, making unified modeling across species difficult and leading to inefficient per-species models. Second, existing animal motion datasets suffer from limited scale and annotation quality, constraining model performance. To address these challenges, we propose UniMo, a unified point cloud-based motion generation framework that bypasses topological discrepancies by converting parametric skeletons into unparametric representations, further enhanced by dynamic sampling that allocates more points to active joints. Additionally, we present UniML3D, a large-scale motion-language dataset spanning both human and animal categories, containing 145,907 motion sequences and 433,388 captions-over 102x larger than existing animal datasets. Our method achieves state-of-the-art results on UniML3D and three public benchmarks including HumanML3D, KIT-ML, and AnimalML3D, demonstrating the feasibility and effectiveness of unified human-animal motion generation. Website: https://steve-zeyu-zhang.github.io/UniMo.

View source

Similar papers

Preprint Sep 2026

Kirin: Animal Motion Generation from In-the-Wild Video

Kirin is introduced, a framework that reconstructs motion from video, learns motion priors at scale, and generates realistic motion that can be directly applied to animated assets that establishes a new foundation for large-scale, text and image conditioned animal motion generation and animation.

Brian Nlong Zhao, Zhuo-Yang Pan, J. Rehg et al. · 1 citation

UniMate: One Unified Model to Animate Diverse Skeletons

UniMate is presented, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining, and outperforms state-of-the-art baselines in quality, generalization, and efficiency.

Lin-Zhan Mou, Jia-Hui Lei, Zhi-Yang Dou et al. · 3 citations
Open access Aug 2026

HardMo++: A Large-Scale Hard-Case Dataset for Motion Capture

HardMo++ is introduced, a scalable benchmark dataset built by an automated pipeline that combines large-scale data collection, re-annotation, and targeted optimization for systematic failure cases and shows that models trained with HardMo++ improve over the corresponding 4DHumans- and HardMo-trained baselines on the pr...

Jun-Ran Peng, Si-Lei Shen, Zong-Xing Li et al. · 0 citations
Preprint Sep 2026

World2Motion: Turning Video World Models into 3D Human Motion Generators

World2Motion, a framework that generates scene-aware 3D human motion and corresponding video from a single image and a text prompt, and proposes a shift-decoupled noise schedule that assigns different noise levels to video and motion through shared denoising progress, reducing motion jitter.

Fang-Yuan Tu, Xiang-Yue Zhang, Yi-Yi Cai et al. · 0 citations
#artificial intelligence Preprint Aug 2026

HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object-Interaction

This work presents HiPHI, a 600+ hour scale high-fidelity whole-body human motion dataset designed to systematically maximize coverage of the human motion and interaction manifold, and introduces a benchmark suite evaluating motion-space diversity, interaction grounding, object consistency, and physical AI applications...

Jiahao Ji, Ji Ma, Runhan Zhang et al. · 2 citations · ⚡1
Preprint Aug 2026

RigidBench: Evaluating Rigid-Body Physics in Video Generation Models

RididBench is introduced, a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description, with per-frame masks, depth, 6-DoF trajectories, and contacts available for scoring.

Swarnim Jain, Shang-Zhe Wu · 5 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.