Author

Muhammad Sabih

h-index 12 View on Semantic Scholar

We have 1 of 43 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Rethinking Neural Nonlinearity as Gating

This paper demonstrates that standard activations -- whether piecewise-linear (ReLU, PReLU, Hardtanh) or smooth (SiLU, Sigmoid, Tanh, GELU) -- are in fact instances of a single Threshold Gating (TG) primitive, and proposes a'Minimal Branch Theorem' which relates the minimum number of required branches in the authors' primitive to the trainability of general deep neural networks.

Muhammad Sabih, Frank Hannig, Jürgen Teich · 0 citations