Multi-Evaluator Preference Alignment Under Scarce Human Feedback Budgets: Theoretical Frameworks and Aggregation Strategies
The alignment of generative artificial intelligence systems with human values and intentions relies heavily on iterative feedback mechanisms. As models scale in complexity, the demand for high-quality human annotation escalates, presenting a critical bottleneck when financial and temporal budgets are constrained. This...