Skip to content

Author

Chao-Yi Hu

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

SpecPV: Improving Self-Speculative Decoding for Long-Context Generation via Partial Verification

To further accelerate speculative decoding in long-context generation, SpecPV is introduced, a self-speculative decoding approach that performs fast verification using partial key-value states (KV) and periodically applies full verification to eliminate accumulated errors.

Zhendong Tan, Xingjun Zhang, Chao-Yi Hu et al. · 7 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.