The Pitfalls of Maximum Likelihood Training of TPMs for Controllable Language Generation
This work finds that likelihood-trained TPMs can result in failed generations due to overly large corrections to the LM’s logits, and trains TPMs with LM-aligned objectives that better align with the LM token-probability space.
Hanzhang Liu, William Zhao, Zi-Lei Shao et al.
· 0 citations