Book
Open access
Aug 2026
Codebook-Based Acceleration for Ternary Language Model Inference
TERINT-GEMV is designed, a multiplier-free bit-serial accelerator that ingests the 6-bit indices directly through an on-chip lookup table, computing ternary × INT8 dot products with dynamic zero-skipping.
Tomas Sousa Pereira, Ruibao Wang, Ikenna Nwozo et al.
· International Symposium on L... · 0 citations