Fangmin Liu

Quantifying Depth Sufficiency in Residual Neural Networks: A First-Order Criterion

How can we determine whether a trained neural network is already deep enough? We study this under a fixed function-preserving residual-growth protocol specifying insertion locations, residual families, zero-output initializations, and zero-state first-order updates. We define first-order residual depth saturation as th...