Devaprabha Biju S

Adaptive Gating Dynamics for Layer-Wise Sparsity Learning and Neural Network Pruning

Deep neural networks often contain substantial parameter redundancy, resulting in unnecessary computational cost and energy consumption. This work presents a dynamically adaptive gating mechanism for learning layer-wise sparsity through differentiable masking. In the proposed framework, each network parameter is associ...