Gradient-guided layerwise adaptive noise injection for pre-trained language model fine-tuning
TL;DR
The core idea is to utilize gradient information generated during optimization to dynamically adjust the noise intensity in a layer-wise and real-time manner to provide a simple yet effective solution for optimization-state aware dynamic regularization.
Abstract
Fine-tuning pre-trained language models (PLMs) is crucial for achieving performance gains in downstream natural language processing tasks, but it is prone to overfitting in low-resource scenarios. Existing noise-based regularization methods typically rely on static parameter statistics or predefined heuristics to mitigate this issue. However, the noise magnitude and injection timing in these approaches depend on fixed hyperparameters or heuristic schedules, making them unable to adapt to the dynamic optimization state of the model during training. To address this limitation, this paper proposes a novel fine-tuning framework named gradient-guided noise injection (GNI). The core idea is to utilize gradient information generated during optimization to dynamically adjust the noise intensity in a layer-wise and real-time manner. Extensive experiments on multiple tasks from the GLUE and SuperGLUE benchmarks demonstrate that GNI generally improves average performance across different pre-trained models and task settings, while exhibiting stable generalizability and robustness. This work provides a simple yet effective solution for optimization-state aware dynamic regularization.