Toward scalable and privacy-preserving deep neural network via algorithmic-cryptographic co-design

Jun Zhou, Longfei Zheng, Chaochao Chen, Yan Wang, Xiaolin Zheng, Bingzhe Wu, Cen Chen, Li Wang, Jianwei Yin

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Deep Neural Networks (DNNs) have achieved remarkable progress in various real-world applications, especially when abundant training data are provided. However, data isolation has become a serious problem currently. Existing works build privacy-preserving DNN models from either algorithmic perspective or cryptographic perspective. The former mainly splits the DNN computation graph between data holders or between data holders and server, which demonstrates good scalability but suffers from accuracy loss and potential privacy risks. In contrast, the latter leverages time-consuming cryptographic techniques, which has strong privacy guarantee but poor scalability. In this article, we propose SPNN-a Scalable and Privacy-preserving deep Neural Network learning framework, from an algorithmic-cryptographic co-perspective. From algorithmic perspective, we split the computation graph of DNN models into two parts, i.e., the private-data-related computations that are performed by data holders and the rest heavy computations that are delegated to a semi-honest server with high computation ability. From cryptographic perspective, we propose using two types of cryptographic techniques, i.e., secret sharing and homomorphic encryption, for the isolated data holders to conduct private-data-related computations privately and cooperatively. Furthermore, we implement SPNN in a decentralized setting and introduce user-friendly APIs. Experimental results conducted on real-world datasets demonstrate the superiority of our proposed SPNN.

Original languageEnglish
Article number53
Pages (from-to)1-21
Number of pages21
JournalACM Transactions on Intelligent Systems and Technology
Volume13
Issue number4
DOIs
Publication statusPublished - Aug 2022

Keywords

  • Privacy-preserving
  • secret sharing
  • homomorphic encryption
  • deep neural network

Fingerprint

Dive into the research topics of 'Toward scalable and privacy-preserving deep neural network via algorithmic-cryptographic co-design'. Together they form a unique fingerprint.

Cite this