MeanFlowAdvantage: Stable Reward Fine-Tuning for Few-Step Average-Velocity Generators
This work introduces MeanFlowAdvantage, a signed advantage-weighted least-squares objective for average-velocity generators, and uses a shared, detached MeanFlow derivative correction to express the reward objective in prediction space while making rollout and reference regularization exact penalties on the average-vel...