When Updating Stops Being Learning: Rethinking LLM Self-Evolution via learnable information gain
A holistic framework based on learnable information gain, which measures how much novel, parameterizable information a round provides relative to the previous round, and proposes ATRI (Adaptive Training Regulation via Information-gain), which reweights samples within a round and halts training across rounds when inform...
Chen-Xu Wang, Chao-Zhuo Li, Xin-Ze Shi et al.
· 0 citations