Open access
Jul 2026
Gradient-guided layerwise adaptive noise injection for pre-trained language model fine-tuning
The core idea is to utilize gradient information generated during optimization to dynamically adjust the noise intensity in a layer-wise and real-time manner to provide a simple yet effective solution for optimization-state aware dynamic regularization.
Qinglin Jiang, Cheng Zeng, Nan Chi
· Scientific Reports · 0 citations