Miao-Sen Chai

PreciseCoder: Faithful and Generalizable Debugging Beyond Unit-Test Rewards

Reinforcement learning (RL) from unit tests is the common recipe for post-training code models, but a unit test only asks whether the final program passes. We analyze what this unit-test-only reward teaches a model during debugging and find that, while it raises pass rates, it also teaches the model to edit more and to...