Author

Krishna Teja Chitty-Venkata

h-index 7 View on Semantic Scholar

We have 2 of 25 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache

H-Spec is a hybrid Mamba-attention parallel drafter that consumes the two target-context sources through complementary modules, and consistently achieves higher throughput while maintaining lower KV cache utilization than baselines across evaluated concurrency levels.

Wei-Fan Jiang, Krishna Teja Chitty-Venkata, Megan Flynn et al. · 0 citations

Book Open access Jul 2026

PKAS: Predictive KVCache-Aware Scheduling for Faster LLM and Transformer Inferences

With rising popularity of LLMs, the performance, scalability, and resource-efficiency of inferences become a crucial challenge. The core part of the inference process is the KV cache, which avoids recomputing intermediate attention states, and the batching strategy that batches multiple requests per forward pass to lev...

Jie Ye, Avinash Maurya, Krishna Teja Chitty-Venkata et al. · IEEE International Symposium... · 1 citation