Nov 2026· Proceedings of the 14th Workshop on Encrypted Computing & Applied Homomorphic Cryptography· 0 citations· 11 references
TL;DR
This paper presents a framework that automatically converts a pre-trained Keras model into a CKKS equivalent, handling parameter inference, bootstrap placement and encrypted execution without retraining, with the user only providing a configuration of the encryption parameters.
Abstract
Machine learning inference on sensitive data exposes user inputs to the server, raising privacy and legal concerns. Fully homomorphic encryption (FHE) resolves this by allowing inference to run directly on encrypted data. However, deploying an FHE neural network currently requires deep cryptographic expertise and significant manual effort for each model. This paper presents a framework that automatically converts a pre-trained Keras model into a CKKS equivalent, handling parameter inference, bootstrap placement and encrypted execution without retraining, with the user only providing a configuration of the encryption parameters. The framework supports dense, convolutional, residual and multi-head attention architectures through a graph-based intermediate representation. The framework is evaluated against Orion on MNIST and CIFAR-10, on the same machine and inputs. On every evaluated input, the encrypted models reproduce the predictions of their plaintext counterparts, with a higher numerical precision than Orion. Orion is faster on a single thread, but with multi-threading and batching the framework reaches up to a 2.6× lower amortised latency. Multi-head attention is demonstrated on a small custom model, representing an architectural capability not present in Orion.
Large Language Models (LLMs) have made it exceptionally convenient for users to send their private data to model providers, which process them in plaintext. Fully Homomorphic Encryption (FHE) promises to secure remote inference by computing directly on encrypted data, yet it has remained prohibitively slow. The effort...
Alessandro Zirilli, Davide Marincione, E. Kornaropoulos et al.· 0 citations
A performance evaluation of three binary classification neural networks on consumer hardware, and a novel method for deriving a network's final classification using the binary step function are proposed.
Lukas Horn, Lennart Svoboda, Simon Engel et al.· Proceedings of the 14th Work...· 0 citations
Odin is the first open-source end-to-end GPU CKKS implementation of Llama-3, an FHE inference system that co-designs ciphertext packing and model execution for Llama and uses a feature-major cross-layer layout to unify residual connections and layer interfaces.
Yu-Hang Fan, Yu-Si Chen, Kan-Yu Ye et al.· arXiv.org· 1 citation
This paper proposes Pacifo, a framework that adapts customized fine-tuning strategies to efficiently evaluate the ResNet20 model in the context of FHE, and introduces a public-private layer partitioning scheme and an efficient ReLU approximation, significantly reducing the number of private layers and costly FHE operat...
Yang-Zhuo Li, Gang He, Rui-Chen Zhang et al.· 0 citations
Fully homomorphic encryption allows arithmetic to be carried out on encrypted values, so that a party performing a computation need not see the data it operates on. This is useful wherever collaborating parties or sites cannot share data records or computed summaries yet need to do a joint analysis. We demonstrate the...
This paper demonstrates that prompt reconstruction, even with knowledge of the DP mechanism, cannot recover more information than is contained in an unrelated prompt, and derives an upper bound on the floating-point error from masking and subsequent noise cancellation as a function of the privacy parameter epsilon.
Shashie Dilhara Batan Arachchige, Robin Carpentier, H. Asghar et al.· arXiv.org· 0 citations
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
MIT News · Artificial Intelligence· news.mit.eduJul 15, 2026
Assistant Professor Pat Pataranutaporn describes a new interface that lets everyday users glimpse inside an AI's neural network before their chatbot ever says a word.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.