Beyond the Best Guess: Improving LLM Solution Coverage with Evolution Strategies
Evolution Strategies (ES), a population-based, gradient-free post-training method that optimizes directly in weight space through random perturbations, achieves consistently higher pass@k than RL and produces a broader output distribution with greater solution coverage.