Parallelism, critical windows, and separations among diffusion language models
A fine-grained comparison of the capacity for parallelism among these three leading approaches is initiated and it is proved that uniform and Gaussian diffusion can sample in a number of forward passes which scales with the dual total correlation of the underlying distribution.