MISO: Model-Internal-State-Guided Optimization for Ranking Models
Model Internal State Optimization (MISO), a systems workflow that uses model internal states (MIS), including parameters, activations, gradients, and normalization statistics, to prioritize such local optimization decisions.