Context-weighted Discrete Flow Matching
This work empirically demonstrates that the uncertainty over the value of each token is closely related to the density of available context in its neighborhood, and proposes a simple modification to the underlying continuous-time Markov chain (CTMC) that incorporates local context information.