Nan-Nan Wu

EvSpark: Lossless Speculative Decoding for Hybrid DNA Foundation Models

Hybrid DNA foundation models combine convolutional, recurrent, and attention layers, making speculative decoding more difficult than truncating a KV cache. We present EvSpark, a speculative decoding system for Evo2 that verifies draft blocks in parallel and restores all three classes of inference state by selecting ret...