Temporal-Attention Head Specialization During Video Diffusion Training
Checkpoint-resolved, per-head analysis under fixed selection rules can expose sparse temporal organization in other factorized video diffusion transformers and, with adapted routing metrics, in joint spatio-temporal architectures.
Taewoo Ha, Shafayat Mowla Anik, Dae Yeol Lee et al.
· 0 citations