SeOPD: Self-Evolving LLMs via Online Policy Distillation from Self-Generated Chain-of-Thought
This work proposes Self-Evolving Online Policy Distillation (SeOPD), which enables LLMs to distill and internalize information generated by their own chain of thought (CoT), thereby improving both non-thinking and deep-thinking capabilities.