Skip to content

Static vs. Adaptive Curriculum Learning for RLOO Fine-Tuning of Language Models

· 0 citations · 6 references

TL;DR

This project asks a focused question: does ordering training data by difficulty make RLOO fine-tuning more effective on a reasoning task, and does a performance-adaptive curriculum outperform a fixed one?

View source

Similar papers

Preprint Jul 2026

Understanding Reasoning from Pretraining to Post-Training

A quantitative account of the pretraining-to-RL interface and a controlled testbed for studying the science of reasoning across the full pretraining-to-post-training pipeline is provided.

Jingyan Shen, Ang Li, Salman Rahman et al. · 0 citations
Jul 2026

LEACL: LLM-Enhanced Automatic Curriculum Learning for Reinforcement Learning in Long-Horizon Manipulation Tasks

LLM-enhanced automatic curriculum learning (LEACL), a framework that integrates LLMs and ACL to address limitations of ACL, is proposed, which achieves better asymptotic performance in terms of the success rates compared to human-designed dense rewards.

Faraz Heravi, James Ouyang, Zi-Fan Xu et al. · 0 citations
Preprint Jul 2026

Cross-Benchmark Generalization in Long-Horizon Agents

Desc descriptive evidence is provided that long-horizon multi-tool post-training can change ways of working that transfer beyond its training domain, and both software-engineering benchmarks improve despite the training collection containing no software-engineering tasks.

Sushant Mehta, Logan Ritchie, Liudas Panavas et al. · 0 citations
Jul 2026

RLPF: Reinforcement Learning from Performance Feedback for Code Generation

This work proposes RLPF, reinforcement learning from performance feedback, which turns execution outcomes into a staged reward, and suggests that code agents can be trained not only to pass tests, but also to optimize the programs they write.

Huihao Jing, Hao-Zhe Cui, Wenbin Hu et al. · 0 citations
Preprint Aug 2026

Question Begets Question: Self-Evolving Curriculum for Reinforcement Fine-Tuning on Competition Mathematics

This work proposes a self-evolving curriculum that, each round, evaluates the current checkpoint, seeds QbQ from the problems it can mostly get right, and trains on the resulting variants; under an identical data budget, this breaks the ceiling and lifts pass@1 to 16.5\% with no sign of saturation after 20 rounds.

Longtian Bao, Jianyou Wang, Yang Zhang et al. · 0 citations

Learning More from Less: Reinforcement Learning from Hindsight

Learning from Hindsight is presented, which brings hindsight relabeling to RL post-training of VLAs by scoring failed rollouts against the tasks they actually achieved, and achieves 5 times improvement in sample efficiency, and outperforms a dense progress-reward baseline on out-of-distribution LIBERO-PRO tasks.

Iris Xu, Sunshine Jiang, John Marangola et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.