Zi-Le Huang

Functional Cross-layer Experts Routing for One-step Diffusion Distillation

DeMoE is proposed, which pairs a persistent shared expert with conditionally routed expert slices across image FFNs, trained under a one-step distribution-matching objective with executed-route supervision, demonstrating that structured internal computation reallocation provides a superior compression paradigm for diff...