The Truncation Blind Spot: How Decoding Strategies Systematically Exclude Human-Like Token Choices
Probability-floor samplers substantially narrow the blind spot, demonstrating that the choice of truncation criterion matters for retaining human-used tokens and motivate decoding methods that preserve contextually appropriate low-probability choices while maintaining generation quality.