P. Mudgal

Do small language models know what they don't know?

This work demonstrates that semantic entropy, computed by generating multiple samples, clustering answers by meaning, and measuring distributional uncertainty, recovers a viable confidence signal and suggests that the value proposition for entropy-based methods in SLMs is not computational savings but intelligent compu...