Jonathan Williams

Adapter Thickets: Splitting an RLVR Budget Beats Concentrating It

Majority voting over sampled completions is the workhorse of test-time scaling, and reinforcement learning with verifiable rewards (RLVR) is the workhorse for making each completion better. The standard pipeline composes the two: train one policy with RLVR, then sample it many times and vote. We show that this composit...