Author

Swastik Singh

h-index 0 View on Semantic Scholar

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

AutoNorm: Understanding Adaptive Normalization in Transformers through Differentiable Gating

This paper proposes AutoNorm-S (Stabilized), a training strategy that mitigates optimization instability through a gate-freezing schedule, and suggests that decoupling normalization selection from optimization noise provides a practical and principled approach for adaptive normalization in Transformer architectures.

Piyush Kaushik Bhattacharyya, Divyanshu Rai, Swastik Singh et al. · 0 citations