2026
TokTier: Exact Stateful Tokenization for Agentic LLM Serving
Zhen-Yu Zhang, Zhi-Chao Cao
· arXiv.org · 1 citation
Sponsored
AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
We have 2 of 6 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Preprint
Jul 2026
TokTier: Exact Stateful CPU+GPU Tokenization for Agentic LLM Serving
TokTier is a stateful CPU+GPU tokenization service for this two-mode workload, under one contract that re-tokenizes a small window around the append and splices only when a per-request check finds a stable pre-tokenization boundary.
Zhen-Yu Zhang, Zhi-Chao Cao
· 3 citations