Kyeongmin Yeo

MUNITE: Unified Multimodal Latent Inference for Any-to-Any Multimodal Generation

We introduce MUNITE, a latent-variable framework for flexible any-to-any multimodal generation that treats encoding and latent generation as the same inference problem under different amounts of observed evidence. Given any subset of modalities, MUNITE models the conditional distribution over the latent representation...