Multimodal Co-Generation With Continuous Bitstream Diffusion
It is shown that continuous bitstream diffusion (CoBit), originally developed for language modeling, provides a unified framework for joint and conditional multimodal generation using the same training and sampling protocol for speech-text and protein sequence-structure modeling.