Preference Optimization for Open-Weight Language Models: A Survey and Low-Resource RLHF Case Study
Open-weight language-model post-training combines preference learning, reinforcement learning, verifiable feedback, and increasingly, agentic training and on-policy distillation. Comparing these systems requires separating their optimization algorithms from their feedback sources, sampling procedures, and evaluation ta...