Scaling laws predict how loss decreases with increases in computation. We show, contrary to conventional wisdom, that architectural interventions can modify scaling exponents in pre-training, leading to power-law improvements in performance as computation increases. As an anchoring point, we consider the architectural...
Zi-Xi Chen, Akshay Vegesna, Samip Dahal et al.· 2 citations
A contextual restless multi-armed bandit (CRMAB) framework in which a grid operator requests load reductions without observing internal job-scheduling decisions is proposed, demonstrating the economic potential of data-center flexibility as a grid service and highlighting the importance of high-quality, open-source AI...
Zi-Xi Chen, Yifu Ding, Rui-Cheng Ao et al.· 0 citations
This work introduces a multi-objective optimization framework that formulates routing as an online linear programming with interpretable decision rewards and applies an efficient bid-price control policy based on the online linear programming that admits requests when their SLO-weighted benefit exceeds their shadow pri...
Zixi Chen, Yinyu Ye, Zijie Zhou· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.