Efficient Sum-Check Protocol for Convolution

被引:0
作者
Ju, Chanyang [1 ,2 ]
Lee, Hyeonbum [1 ,2 ]
Chung, Heewon [1 ,2 ]
Seo, Jae Hong [1 ,2 ]
Kim, Sungwook [3 ]
机构
[1] Hanyang Univ, Dept Math, Seoul 04763, South Korea
[2] Hanyang Univ, Res Inst Nat Sci, Seoul 64763, South Korea
[3] Seoul Womens Univ, Dept Informat Secur, Seoul 01797, South Korea
基金
新加坡国家研究基金会;
关键词
Verifiable computation; matrix multiplication; convolutional neural networks; interactive proofs; sum-check protocol;
D O I
10.1109/ACCESS.2021.3133442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications have recently adopted machine learning and deep learning techniques. Convolutional neural networks (CNNs) are made up of sequential operations including activation, pooling, convolution, and fully connected layer, and their computation cost is enormous, with convolution and fully connected layer dominating. In general, a user with insufficient computer capacity delegated certain tasks to a server with sufficient computing power, and the user may want to verify that the outputs are truly machine learning model predictions. In this paper, we are interested in verifying that the delegation of CNNs, one of the deep learning models for image recognition and classification, is correct. Specifically, we focus on the verifiable computation of matrix multiplications in a CNN convolutional layer. We use Thaler's idea (CRYPTO 2013) for validating matrix multiplication operations and present a predicate function based on the insight that the sequence of operations can be viewed as sequential matrix multiplication. Furthermore, we lower the cost of proving by splitting a convolution operation into two halves. As a result, we can provide an efficient sum-check protocol for a convolution operation that, like the state-of-the-art zkCNN (ePrint 2021) approach, achieves asymptotically optimal proving cost. The suggested protocol is about 2x cheaper than zkCNN in terms of communication costs. We also propose a verified inference system based on our method as the fundamental building component.
引用
收藏
页码:164047 / 164059
页数:13
相关论文
共 30 条
  • [21] p-im2col: Simple Yet Efficient Convolution Algorithm With Flexibly Controlled Memory Overhead
    Trusov, Anton, V
    Limonova, Elena E.
    Nikolaev, Dmitry P.
    Arlazarov, Vladimir V.
    IEEE ACCESS, 2021, 9 : 168162 - 168184
  • [22] Im2col-Winograd: An Efficient and Flexible Fused-Winograd Convolution for NHWC Format on GPUs
    Zhang, Zhiyi
    Zhang, Pengfei
    Xu, Zhuopin
    Yan, Bingjie
    Wang, Qi
    53RD INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2024, 2024, : 1072 - 1081
  • [23] Lightweight Automatic Modulation Classification Based on Efficient Convolution and Graph Sparse Attention in Low-Resource Scenarios
    Cai, Zhuoran
    Wang, Chuan
    Ma, Wenxuan
    Li, Xiangzhen
    Zhou, Ruoyu
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (04): : 3629 - 3638
  • [24] A Stride-Based Convolution Decomposition Method to Stretch CNN Acceleration Algorithms for Efficient and Flexible Hardware Implementation
    Yang, Chen
    Wang, Yizhou
    Wang, Xiaoli
    Geng, Li
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2020, 67 (09) : 3007 - 3020
  • [25] Secure and Efficient Protocol for Outsourcing Large-Scale Matrix Multiplication to the Cloud
    Wu, Yu
    Liao, Yongjian
    Liang, Yikuan
    Liu, Yulu
    IEEE ACCESS, 2020, 8 : 227556 - 227565
  • [26] Secure sustainable storage auditing protocol (SSSAP) with efficient key updates for cloud computing
    Zheng, Wenying
    Liu, Dengzhi
    Li, Xiong
    Sangaiah, Arun Kumar
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2020, 28
  • [27] CoRec: An Efficient Internet Behavior-based Recommendation Framework with Edge-cloud Collaboration on Deep Convolution Neural Networks
    Li, Yangfan
    Li, Kenli
    Wei, Wei
    Zhou, Tianyi
    Chen, Cen
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2023, 19 (02)
  • [28] ACPP-Net: Enhancing Strip Steel Surface Defect Detection With Efficient Adaptive Convolution and Channel-Spatial Pyramid Pooling
    Li, Rongyi
    Hou, Kailin
    Zhu, Meiwen
    Dai, Qiuming
    Ni, Jun
    Liu, Xianli
    Li, Xinyu
    IEEE ACCESS, 2024, 12 : 152072 - 152086
  • [29] Energy-efficient cooperative two-hop amplify-and-forward relay protocol in cognitive radio networks
    Cai, Caixia
    Qiu, Runhe
    IET COMMUNICATIONS, 2016, 10 (16) : 2135 - 2142
  • [30] Secure and Efficient Two-Party Quantum Scalar Product Protocol With Application to Privacy-Preserving Matrix Multiplication
    Liu, Wen-Jie
    Li, Zi-Xian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (11) : 4456 - 4469