Peiyuan Liu

Into the ORBIT for Time Series: Training Regimes for Foundation Models

This work introduces ORBIT (Omni-Range Bootstrap Incremental Training), a training paradigm that makes this distribution explicit and controllable and introduces Rank-Guided Cross-Depth Alignment, a training objective that uses late-layer representations as stop-gradient teachers for shallow layers without additional i...