Rubrics as Privileged Information for Open-Ended Generation
It is shown that soft rubric PI provides a larger and more effective training signal on student roll-outs than hard reference completion PI in this regime, and contrary to intuition, soft rubric PI provides a larger and more effective training signal than hard reference completion PI in this regime.