Popular but Wrong: Understanding and Mitigating LLM Overconfidence through Knowledge Popularity
It is shown that popularity-related signals can mitigate overconfidence and improve overall confidence estimation, and incorporate knowledge popularity reduces average confidence on incorrect answers and improves overall confidence estimation.
Shiyu Ni, Keping Bi, Jiafeng Guo et al.
· 6 citations