Zheng-Yu Zhang

Guiding the coarse levels of semantic IDs makes the fine levels learnable

Generative retrieval represents each item by a short Semantic ID and casts recommendation as autoregressive generation of that sequence. Because the tokenizer is trained independently to reconstruct an item embedding, its codes are aligned with neither the downstream LLM nor the end task. Nearly every SID system theref...