Where Does Robustness Live? Neuron-Guided Adaptation for Retrieval-Augmented Language Models
NeuRIT is proposed, a Neuron-guided Robust Instruction-Tuning framework built on a localization-first perspective that mines context-aware neurons associated with relevant and irrelevant context processing, and uses them as anchors to selectively adapt both the identified neuron groups and the layers in which they concentrate.
Jae Lee, Jaemin Kim, Sumyeong Ahn et al.
· 0 citations