LADDER: Diagnosing Domain-Level Self-Assessment Under Noisy Feedback
Knowing when they are reliable is essential for language models to support human-AI collaboration. Yet interaction feedback is not always complete or correct, and may mislead models'understanding of their own capabilities. We introduce LADDER to study how language models assess themselves under unreliable feedback. Our...
Zhen-Shuai Yin, Jian-Shuai Liang, Xu-Yue Xiong et al.
· 0 citations