Ji-hoon Kim

Learning Where It Matters: Geometric Anchoring for Robust Preference Alignment

Geometric Anchor Preference Optimization is proposed, which replaces the fixed reference with a dynamic, geometry-aware anchor: an adversarial local perturbation of the current policy within a small radius that serves as a pessimistic baseline that enables an adaptive reweighting mechanism, modulating the importance of...