Detailed Information

Cheetah: Optimizing and Accelerating Homomorphic Encryption for Private Inference

Cited 43 time in Web of Science Cited 53 time in Scopus

Reagen, Brandon; Choi, Woo-Seok; Ko, Yeongil; Lee, Vincent T.; Lee, Hsien-Hsin S.; Wei, Gu-Yeon; Brooks, David

Issue Date
Institute of Electrical and Electronics Engineers Inc.
IEEE High-Performance Computer Architecture Symposium Proceedings, Vol.2021-February, pp.26-39
As the application of deep learning continues to grow, so does the amount of data used to make predictions. While traditionally big-data deep learning was constrained by computing performance and off-chip memory bandwidth, a new constraint has emerged: privacy. One solution is homomorphic encryption (HE). Applying HE to the client-cloud model allows cloud services to perform inferences directly on clients' encrypted data. While HE can meet privacy constraints it introduces enormous computational challenges and remains impractically slow on current systems. This paper introduces Cheetah, a set of algorithmic and hardware optimizations for server-side HE DNN inference. Cheetah proposes HE-parameter tuning and operator scheduling optimizations, which together deliver up to 79 x speedup over the state-of-the-art. However, HE inference still falls short of real-time inference speeds by nearly four orders of magnitude. Cheetah further proposes an accelerator architecture to understand the degree of speedup hardware can provide and whether it can bridge HE's real-time performance gap. We evaluate several DNNs and find that privacy-preserving HE inference for ResNet50 can approach real-time speeds with a 587mm(2) accelerator dissipating 30W in 5nm.
Files in This Item:
There are no files associated with this item.
Appears in Collections:

Related Researcher

  • College of Engineering
  • Department of Electrical and Computer Engineering
Research Area DRAM-PIM, High Bandwidth Memory Interface, O Links, Performance Modeling for I


Item View & Download Count

  • mendeley

Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.