Preprint
Aug 2026
RAC: Reference-Aware Activation Compression for Communication-Efficient Split LLM Inference
System is presented, a reference-aware codec that retrieves exact-token historical spans for prefill uplinks, reuses the reconstructed uplink state for same-round prefill downlinks, and generates boundary-specific decode references with lightweight causal predictors.
Guotao Yang, M. Zhao, Haopeng Li et al.
· 0 citations