We have 4 of 25 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Speculative decoding accelerates language model inference by verifying multiple draft tokens in a single target-model pass. Recent parallel drafters have achieved breakthrough performance in frontier production models, but their effectiveness deteriorates as the entropy of target distributions increases due to insuffic...
A lightweight quality gate identifies coverage gaps in initial keyword results, adaptively routing only the ∼ 10% of users who benefit from semantic prospecting to the LLM path, and captures the bulk of semantic prospecting gains in Relevance Score while maintaining competitive retargeting performance at a 90% reductio...
TSRouter, a graph-based dynamic routing framework that demonstrates robust zero-shot plug-and-play generalization to unseen models and novel tasks and preserves high performance while reducing computational overhead through cost-aware optimization.
This work presents a unified formulation of LLM routing as a sequential decision process characterized by five components: context encoders, model encoders, scoring functions, decision rules, and learning signals, covering single-turn, multi-turn, and personalized routing.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
