Private LLM Inference: Optimizing Tricycle
The adoption of Large Language Models (LLM) in scenarios with sensitive data requires the use of privacy-preserving technologies to guarantee confidentiality. Private LLM inference using Fully-Homomorphic Encryption (FHE) guarantees data privacy by encrypting the input beforehand and performing inference directly over...