Lifelong Learning of Video Diffusion Models From a Single Video Stream
It is demonstrated that training autoregressive video diffusion models from such a stream, resembling the experience of embodied agents, is not only possible but can also perform comparably to standard offline training given the same number of gradient steps.