We have 3 of 12 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
This work introduces XTC (Exclude Top Choices), a lightweight head-aware decoding operator that targets this regime of open-ended generation in which several continuations are plausible but too much probability mass remains concentrated on the most generic choice.
Large Language Models generate text autoregressively, but open-ended generation is prone to verbatim looping, in which models repeat spans already present in context. Standard defenses such as repetition, presence, and frequency penalties and n-gram blocking act on token recurrence rather than the sequential structure...
CoGate is proposed, a confidence-gated co-decoding approach that controls the expert's influence on the co-decoding process based on its confidence, and outperforms existing co-decoding methods (CoSec+) across multiple benchmarks.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
