Adaptive Competence-Boundary Curricula for Countdown with RLOO

TL;DR

This work investigates whether curriculum-based prompt selection can improve sample efficiency for Countdown arithmetic reasoning by focusing training on prompts near the model’s current competence boundary, and introduces an adaptive competence-boundary curriculum for RLOO.