MuseCritic: Learning Multi-Aspect Song Rewards through Natural-Language Aesthetic Critiques
MuseCritic is introduced, a semi-scalar reward model that generates a natural-language critique covering five aesthetic dimensions and uses it as an intermediate representation to predict continuous reward scores, showing that critique-conditioned reward modeling reduces scoring error and provides an effective optimiza...