Maverick: Private and Verifiable LLM Inference Made Practical via Matrix-Vector Multiplication Delegation
This paper presents Maverick, a novel approach to private and verifiable LLM inference based on a protocol for delegating matrix-vector multiplication, a dominant operation in LLMs, and combines this verification primitive with LPN-based pseudorandom masking to provide input privacy.