Skip to content

Reference Fidelity in AI-Generated Short-Form Video Across Four Prompt Packages

Sep 2026 · Communications in Humanities Research · Vol 123, pp. 7-13 · 0 citations

Abstract

Generative video systems can produce short clips from textual and visual instructions, yet their ability to preserve the content of a human reference remains uncertain. This exploratory study examines 160 videos generated with Doubao-Seedance-2.0 from 40 human-made short-form videos drawn from Douyin and Xiaohongshu. The references were divided evenly among humor, informational, demonstration, and storytelling content. Qwen3.8-Max analyzed each reference and produced four prompt packages labeled vague, vivid, keyword, and image-based. The fourth package also contained timestamped reference frames, frame descriptions, identity constraints, and sequence instructions, so it is treated as a multimodal reference condition rather than a pure image condition. Each prompt was used once under the same default settings, and no output was edited after generation. Metadata inspection covered the complete corpus. All 40 groups received a standardized frame review, and eight groups were examined at three temporal positions. Outputs usually retained the source topic and central action. Fidelity was stronger for one-subject situations than for multi-step procedures, factual labels, comic timing, or longer causal sequences. The multimodal package appeared closer to source composition in several cases, yet the one-shot design and unequal prompt information prevent a causal ranking. The study therefore evaluates reference fidelity rather than virality or prompt efficacy.

View source

Similar papers

Preprint Sep 2026

Complementary Retrieval-Augmented Prompting for Consistent Long-Form Video Generation

While recent video foundation models excel at generating high-quality short videos, long-form video generation remains a critical challenge, where a major bottleneck lies in conditioning independently generated shots to preserve consistent characters, scenes, and objects throughout a story. Existing training-free appro...

Xiang-Han Wei, Xiao-Da Yang, Zhi Wang et al. · 0 citations
Preprint Oct 2026

Towards Unified Evaluation of Prompt Enhancers for Video Generation

Modern video generators can realize increasingly complex visual narratives, positioning the prompt enhancer (PE) as a critical bridge from concise user instructions and multimodal references to structured cinematic plans. However, existing PE evaluation relies on rendered videos, imposing substantial computational and...

Ya-Wen Shao, Yu-Bo Zhu, Zi-Yun Dai et al. · 0 citations
Preprint Sep 2026

WanPE: Towards Cinematic Prompt Enhancement for Modern Text-to-Video Generation

WanPE formulates shot-level cinematic plans via video-grounded reverse construction and employs Semantic-Consistency GRPO (SC-GRPO) to faithfully preserve user requirements across shots and over time, leading all evaluated commercial offerings at 5-15 seconds and remains competitive with Seedance 2.5 at 30 seconds.

Yu-Bo Zhu, Ya-Wen Shao, Zi-Yun Dai et al. · 0 citations
Preprint Sep 2026

ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts

Audio-video generation using heterogeneous multimodal references has emerged as a new challenge, requiring both compositional control over generation and grounded understanding of multimodal context. In this paper, we introduce ORAV Bench for Omni Reference Audio-Video Generation, comprising 380 task instances with 2-1...

Jia-Cheng Hua, Xiao-Kun Feng, Jia-Qi Hua et al. · 0 citations
Preprint Sep 2026

MSR: Multiple Subject Reference for Video Generation

Conditioning a video generator on multiple images requires preserving appearance while associating each reference with its intended role. We present MSR (Multiple Subject Reference), a slot-aware conditioning scheme for LTX-based video generation. Each reference image is independently encoded as a static clip and repre...

Guan-Nan Li, Jia-Ji Chen, Jing-Yuan Liao et al. · 0 citations

DRS Digital Library

Danyal Sarfraz, Raja Mubashar Karim, KwanMyung Kim · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

GPT-Lab Oct 12, 2026

AI Has Grown Up. Have We?

AI is moving beyond impressive demos. After World Summit AI 2026 in Amsterdam, GPT-Lab's Muhammad Waseem reflects on what organizations need to make AI agents reliable, responsible and genuinely useful in everyday work. The post AI Has Grown Up. Have We? appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.