Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings governed by social and institutional norms, some user preferences may be inappropriate to apply. We introduce BenchPreS, which evaluates wh...
Sangyeon Yoon, SunKyoung Kim, Hyesoo Hong et al.· arXiv.org· 8 citations· ⚡2
CALIF is a lightweight method that augments verifier rewards with a calibrated likelihood-based bonus to preserve response quality and outperforms corresponding base policies in 40 of 45 model-metric comparisons across three rubric-based instruction-following benchmarks.
Sangyeon Yoon, Wooseok Seo, Hamish Ivison et al.· 0 citations
This work shows that paraphrase robustness is a core requirement for reliable VLM-based reward modeling in robotics and introduces ROBORMBENCH, a benchmark with 2,390 real-robot trajectories, ground-truth progress labels, and 21,673 verified paraphrases spanning lexical, syntactic, and action-goal rewrites.
Wonje Jeung, Sangyeon Yoon, Hyesoo Hong et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.