Jul 2026
Neural Collapse Is Forbidden: Information Floors in Language Models
It is argued that within-class variance in language-model representations is allocated information storage, and that the allocation obeys a law, and that the allocation obeys a law.
B. Abrahao
· arXiv.org · 0 citations