Yanhong Li

Reduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference

Reduced Matrix Multiplication is proposed, a training-free, input-adaptive inference method that reduces Transformer matrix products by selecting informative slices along their contraction dimensions, without modifying model weights, and it is shown that the same principle extends to multimodal vision-language inference.