Preprint
Sep 2026
An Open-Source End-to-End FHE Implementation for Privacy-Preserving Llama 3 8B Inference
Odin is the first open-source end-to-end GPU CKKS implementation of Llama-3, an FHE inference system that co-designs ciphertext packing and model execution for Llama and uses a feature-major cross-layer layout to unify residual connections and layer interfaces.
Yu-Hang Fan, Yu-Si Chen, Kan-Yu Ye et al.
· 0 citations