Tianwei Zhang

Self-Improving is Often Sudden: Enlightenment-style Finetuning for Large-Scale Models

The pursuit of autonomously self-improving models has attracted growing interest in the era of large-scale foundation models. Drawing inspiration from the concept of"enlightenment"or"aha moment"in human brain, we hypothesize that large models exhibit an analogous enlightenment phenomenon-a latent capacity for sudden ca...