Efficient Sum-Check Protocol for Convolution

被引:0
作者
Ju, Chanyang [1 ,2 ]
Lee, Hyeonbum [1 ,2 ]
Chung, Heewon [1 ,2 ]
Seo, Jae Hong [1 ,2 ]
Kim, Sungwook [3 ]
机构
[1] Hanyang Univ, Dept Math, Seoul 04763, South Korea
[2] Hanyang Univ, Res Inst Nat Sci, Seoul 64763, South Korea
[3] Seoul Womens Univ, Dept Informat Secur, Seoul 01797, South Korea
基金
新加坡国家研究基金会;
关键词
Verifiable computation; matrix multiplication; convolutional neural networks; interactive proofs; sum-check protocol;
D O I
10.1109/ACCESS.2021.3133442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications have recently adopted machine learning and deep learning techniques. Convolutional neural networks (CNNs) are made up of sequential operations including activation, pooling, convolution, and fully connected layer, and their computation cost is enormous, with convolution and fully connected layer dominating. In general, a user with insufficient computer capacity delegated certain tasks to a server with sufficient computing power, and the user may want to verify that the outputs are truly machine learning model predictions. In this paper, we are interested in verifying that the delegation of CNNs, one of the deep learning models for image recognition and classification, is correct. Specifically, we focus on the verifiable computation of matrix multiplications in a CNN convolutional layer. We use Thaler's idea (CRYPTO 2013) for validating matrix multiplication operations and present a predicate function based on the insight that the sequence of operations can be viewed as sequential matrix multiplication. Furthermore, we lower the cost of proving by splitting a convolution operation into two halves. As a result, we can provide an efficient sum-check protocol for a convolution operation that, like the state-of-the-art zkCNN (ePrint 2021) approach, achieves asymptotically optimal proving cost. The suggested protocol is about 2x cheaper than zkCNN in terms of communication costs. We also propose a verified inference system based on our method as the fundamental building component.
引用
收藏
页码:164047 / 164059
页数:13
相关论文
共 30 条
  • [1] Learning Versatile Convolution Filters for Efficient Visual Recognition
    Han, Kai
    Wang, Yunhe
    Xu, Chang
    Xu, Chunjing
    Wu, Enhua
    Tao, Dacheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 7731 - 7746
  • [2] More Logarithmic-factor Speedups for 3SUM, (median, plus )-convolution, and Some Geometric 3SUM-hard Problems
    Chan, Timothy M.
    ACM TRANSACTIONS ON ALGORITHMS, 2020, 16 (01)
  • [3] Energy-Efficient Convolution Architecture Based on Rescheduled Dataflow
    Jo, Jihyuck
    Kim, Suchang
    Park, In-Cheol
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2018, 65 (12) : 4196 - 4207
  • [4] Gaussian Dynamic Convolution for Efficient Single-Image Segmentation
    Sun, Xin
    Chen, Changrui
    Wang, Xiaorui
    Dong, Junyu
    Zhou, Huiyu
    Chen, Sheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2937 - 2948
  • [5] SpVOS: Efficient Video Object Segmentation With Triple Sparse Convolution
    Lin, Weihao
    Chen, Tao
    Yu, Chong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 5977 - 5991
  • [6] Splatter: An Efficient Sparse Image Convolution for Deep Neural Networks
    Lee, Tristan
    Lee, Byeong Kil
    2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI 2021), 2021, : 506 - 509
  • [7] Efficient depthwise separable convolution accelerator for classification and UAV object detection
    Li, Guoqing
    Zhang, Jingwei
    Zhang, Meng
    Wu, Ruixia
    Cao, Xinye
    Liu, Wenzhao
    NEUROCOMPUTING, 2022, 490 : 1 - 16
  • [8] Efficient Implementation of 2-D Convolution on DRRA and DiMArch Architectures
    Pudi, Dhilleswararao
    Ryansh, Rajeev
    Boppu, Srinivas
    Yang, Yu
    Hemani, Ahmed
    THE PROCEEDINGS OF THE 13TH INTERNATIONAL SYMPOSIUM ON HIGHLY EFFICIENT ACCELERATORS AND RECONFIGURABLE TECHNOLOGIES, HEART 2023, 2023, : 86 - 92
  • [9] Im2win: Memory Efficient Convolution On SIMD Architectures
    Lu, Shuai
    Chu, Jun
    Liu, Xu T.
    2022 IEEE HIGH PERFORMANCE EXTREME COMPUTING VIRTUAL CONFERENCE (HPEC), 2022,
  • [10] LeapConv: An Energy-Efficient Streaming Convolution Engine with Reconfigurable Stride
    Filippas, Dionysios
    Nicopoulos, Chrysostomos
    Dimitrakopoulos, Giorgos
    2022 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI 2022), 2022, : 200 - 205