The horizontal reactor serves as a critical piece of equipment in petrochemical production and operates under extreme conditions, including high temperature, high pressure, and strong corrosion. Under such conditions, rolling bearings are prone to faults caused by excessive vibration and lubrication failure, which may...
Wanyao Zhang, Yu-Chen Li, Xin Pan et al.· Structural Health Monitoring· 0 citations
Optimizer momentum is usually stored as a parameter-sized moving average of past gradients, which makes history costly and fixes each past signal in the coordinates in which it was computed. We introduce Backpropagated Output Momentum (BOM), which instead stores a compact moving average of prediction errors at the mode...
Yu-Chen Li, Zong-Qi Fan, Nguyen H. Tran et al.· 0 citations
Sparse expert models can distribute traffic evenly while still grouping incompatible training signals within the same experts. We study routing as a gradient-partitioning problem and introduce gradient-aligned routing (GAR), whose load-normalized router objective rewards grouping observations with aligned gradients. On...
Yu-Chen Li, Ming-Yue Du, Zong-Qi Fan et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.