Zhikai Ding

Understanding Curriculum Learning in Large Language Models via Cross-Difficulty Optimization Dynamics

It is shown that the transfer relationship between different difficulty levels characterizes the optimization dynamics induced by curriculum learning, which in turn explains the effectiveness of different curriculum schedules, and formalize this relationship as Relative Transfer, a principled measure of cross-difficult...