Bicoptor: Two-round Secure Three-party Non-linear Computation without Preprocessing for Privacy-preserving Machine Learning

Type: Preprint

Publication Date: 2022-10-04

Citations: 0

DOI: https://doi.org/10.1109/sp46215.2023.00074

Abstract

The overhead of non-linear functions dominates the performance of the secure multiparty computation (MPC) based privacy-preserving machine learning (PPML). This work introduces a family of novel secure three-party computation (3PC) protocols, Bicoptor, which improve the efficiency of evaluating non-linear functions. The basis of Bicoptor is a new sign determination protocol, which relies on a clever use of the truncation protocol proposed in SecureML (S\&P 2017). Our 3PC sign determination protocol only requires two communication rounds, and does not involve any preprocessing. Such sign determination protocol is well-suited for computing non-linear functions in PPML, e.g. the activation function ReLU, Maxpool, and their variants. We develop suitable protocols for these non-linear functions, which form a family of GPU-friendly protocols, Bicoptor. All Bicoptor protocols only require two communication rounds without preprocessing. We evaluate Bicoptor under a 3-party LAN network over a public cloud, and achieve more than 370,000 DReLU/ReLU or 41,000 Maxpool (find the maximum value of nine inputs) operations per second. Under the same settings and environment, our ReLU protocol has a one or even two orders of magnitude improvement to the state-of-the-art works, Falcon (PETS 2021) or Edabits (CRYPTO 2020), respectively without batch processing.

Locations

  • arXiv (Cornell University) - View - PDF

Similar Works

Action Title Year Authors
+ PDF Chat Bicoptor: Two-round Secure Three-party Non-linear Computation without Preprocessing for Privacy-preserving Machine Learning 2023 Lijing Zhou
Ziyu Wang
Hongrui Cui
Qingrui Song
Yu Yu
+ Bicoptor: Two-round Secure Three-party Non-linear Computation without Preprocessing for Privacy-preserving Machine Learning 2022 Lijing Zhou
Ziyu Wang
Hongrui Cui
Qingrui Song
Yu Yu
+ Bicoptor 2.0: Addressing Challenges in Probabilistic Truncation for Enhanced Privacy-Preserving Machine Learning 2023 Lijing Zhou
Qingrui Song
Su Zhang
Ziyu Wang
Xianggui Wang
Yong Li
+ Morse-STF: Improved Protocols for Privacy-Preserving Machine Learning 2021 Qizhi Zhang
Sijun Tan
Lichun Li
Yun Zhao
Dong Yin
Shan Yin
+ PDF Chat The Communication-Friendly Privacy-Preserving Machine Learning against Malicious Adversaries 2024 Tianpei Lu
Bingsheng Zhang
Lichun Li
Kui Ren
+ Trident: Efficient 4PC Framework for Privacy Preserving Machine Learning 2020 Harsh Chaudhari
Rahul Rachuri
Ajith Suresh
+ HD-cos Networks: Efficient Neural Architectures for Secure Multi-Party Computation 2021 Wittawat Jitkrittum
Michał Łukasik
Ananda Theertha Suresh
Felix X. Yu
Gang Wang
+ MORSE-STF: A Privacy Preserving Computation System. 2021 Qizhi Zhang
Yuan Zhao
Lichun Li
JiaoFu Zhang
Qichao Zhang
Yashun Zhou
Dong Yin
Sijun Tan
Shan Yin
+ PrivPy: Enabling Scalable and General Privacy-Preserving Machine Learning 2018 Yi Li
Yitao Duan
Yu Yu
Shuoyao Zhao
Wei Xu
+ PDF Chat EVA-S3PC: Efficient, Verifiable, Accurate Secure Matrix Multiplication Protocol Assembly and Its Application in Regression 2024 S. Andrew Peng
Tianrui Liu
Terence Tao
D.X. Zhao
Hao Sheng
Haogang Zhu
+ MPCLeague: Robust MPC Platform for Privacy-Preserving Machine Learning 2021 Ajith Suresh
+ CECILIA: Comprehensive Secure Machine Learning Framework 2022 Ali Burak Ünal
Mete Akgün
Nico Pfeifer
+ PDF Chat Low-Latency Privacy-Preserving Deep Learning Design via Secure MPC 2024 Ke Lin
Yasir Glani
Ping Luo
+ PDF Chat Hawk: Accurate and Fast Privacy-Preserving Machine Learning Using Secure Lookup Table Computation 2024 Hamza Saleem
Amir Ziashahabi
Muhammad Naveed
Salman Avestimehr
+ PDF Chat Hawk: Accurate and Fast Privacy-Preserving Machine Learning Using Secure Lookup Table Computation 2024 Hamza Saleem
Amir Ziashahabi
Muhammad Naveed
Salman Avestimehr
+ PDF Chat Compact: Approximating Complex Activation Functions for Secure Computation 2024 Mazharul Islam
Sunpreet S. Arora
Rahul Chatterjee
Peter Rindal
Maliheh Shirvanian
+ CrypTen: Secure Multi-Party Computation Meets Machine Learning 2021 Brian Knott
Shobha Venkataraman
Awni Hannun
Shubhabrata Sengupta
Mark Ibrahim
Laurens van der Maaten
+ CryptGPU: Fast Privacy-Preserving Machine Learning on the GPU 2021 Sijun Tan
Brian Knott
Yuan Tian
David J. Wu
+ Compact: Approximating Complex Activation Functions for Secure Computation 2023 Mazharul Islam
Sunpreet S. Arora
Rahul Chatterjee
Peter Rindal
Maliheh Shirvanian
+ CodedPrivateML: A Fast and Privacy-Preserving Framework for Distributed Machine Learning 2019 Jinhyun So
Başak Güler
A. Salman Avestimehr

Works That Cite This (0)

Action Title Year Authors

Works Cited by This (0)

Action Title Year Authors