Contextual Credit Policy Optimization
Contextual Credit Policy Optimization weights observation-matched peers from other trajectories by contextual similarity, computed from frozen LLM representations and accumulated trajectory statistics, allowing peers from similar contexts to contribute more to a step's baseline.
Hui-Wen Han, Zi-Yao Zeng, Zi-Hao Zhu et al.
· 0 citations