Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding
DBloom speeds up generation with an efficient draft model (drafter) that proposes tokens for a target model to verify in one pass, preserving the target's output distribution and recommending the histogram as a preflight check before spending training compute.
Ephrem C. Wu
· 0 citations