Qi-Xin Xu

PRISM: Promoting Sampling Diversity of Large Language Models with Implicit Stochastic Modulation

Large language models (LLMs) exhibit mode collapse, where their output distribution concentrates on familiar semantic modes. When diversity disappears, repeated sampling becomes semantic repetition rather than discovery, making rare but stronger solutions unlikely to surface and leaving self-evolution and continual lea...