We have 2 of 10 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
The chat-to-agentic gap in current inference benchmarks is quantified and per-kernel GPU resource utilisation via roofline analysis is characterised via roofline analysis.
Agentic inference now dominates the LLM inference landscape, requiring LLMs to actively engage in multi-turn interactions with tool-calling capabilities. This introduces a more complex workload for the underlying inference system: serving stages such as prefill and decode exhibit substantially different behaviors and d...
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
