Learning to Solve Hard Problems in RL for LLMs by Never Giving Up
NGU, a simple adaptive sampling method that keeps generating samples for a problem until one is correct, is introduced, a simple adaptive sampling method that naturally uses fewer samples to filter out easy problems and allocates more compute to solving harder problems.
Michael Noukhovitch, Hamish Ivison, Nathan Lambert et al.
· 1 citation