Smriti Regmi

CausalGate: Causal Importance Distillation for Transformer Module Pruning

This work introduces CausalGate, an intervention-guided framework for compute-efficient transformer inference, which consistently outperforms prominent dynamic routing and layer-skipping baselines, translating theoretical compute savings into concrete hardware latency reductions with zero operational overhead.