Chuck Rosenberg

PinGER: Token-Efficient Generative Retrieval with Semantic IDs

Generative retrieval replaces nearest-neighbor search with token-by-token decoding of an item's semantic ID (SID). But existing SID-based methods primarily use L levels of tokens sequentially to represent each item in the input history. As a result, a fixed context window holds L times fewer items than it would with on...