Federated Repair of Deep Neural Networks

被引:0
作者
Li Calsi, Davide [1 ]
Laurent, Thomas [2 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
来源
PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL WORKSHOP ON DEEP LEARNING FOR TESTING AND TESTING FOR DEEP LEARNING, DEEPTEST 2024 | 2024年
关键词
Deep Neural Networks; DNN repair; federation;
D O I
10.1145/3643786.3648025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As DNNs are embedded in more and more critical systems, it is essential to ensure that they perform well on specific inputs. DNN repair has shown good results in fixing specific misclassifications in already trained models using additional data, even surpassing additional training. In safety-critical applications, such as autonomous driving, collaboration between industrial actors would lead to more representative datasets for repair, that would enable to obtain more robust models and thus safer systems. However, these companies are reluctant to share their data, to both protect their intellectual property and the privacy of their users. Federated Learning is an approach that allows for collaborative, privacy-preserving training of DNNs. Inspired by this technique, this work proposes Federated Repair in order to collaboratively repair a DNN model without the need for sharing any raw data. We implemented Federated Repair based on a state-of-the-art DNN repair technique, and applied it to three DNN models, with federation size from 2 to 10. Results show that Federated Repair can achieve the same repair efficiency as non-federated DNN repair using the pooled data, despite the presence of rounding errors when aggregating clients' results.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 30 条
  • [1] [Anonymous], 2023, Repository for the paper "Arachne: Search-Based Repair of Deep Neural Networks
  • [2] bashtage, 2023, Implementation of ChaCha cipher-based PRNG
  • [3] Practical Secure Aggregation for Privacy-Preserving Machine Learning
    Bonawitz, Keith
    Ivanov, Vladimir
    Kreuter, Ben
    Marcedone, Antonio
    McMahan, H. Brendan
    Patel, Sarvar
    Ramage, Daniel
    Segal, Aaron
    Seth, Karn
    [J]. CCS'17: PROCEEDINGS OF THE 2017 ACM SIGSAC CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2017, : 1175 - 1191
  • [4] Budach L, 2022, Arxiv, DOI [arXiv:2207.14529, 10.48550/arXiv.2207.14529, DOI 10.48550/ARXIV.2207.14529]
  • [5] Adaptive Search-based Repair of Deep Neural Networks
    Calsi, Davide Li
    Duran, Matias
    Laurent, Thomas
    Zhang, Xiao-Yi
    Arcaini, Paolo
    Ishikawa, Fuyuki
    [J]. PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023, 2023, : 1527 - 1536
  • [6] Distributed Repair of Deep Neural Networks
    Calsi, Davide Li
    Duran, Matias
    Zhang, Xiao-Yi
    Arcaini, Paolo
    Ishikawa, Fuyuki
    [J]. 2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2023, : 83 - 94
  • [7] Calsi Davide Li, 2024, Repository for the paper "Federated Repair of Deep Neural Networks
  • [8] Understanding Distributed Poisoning Attack in Federated Learning
    Cao, Di
    Chang, Shan
    Lin, Zhijian
    Liu, Guohua
    Sunt, Donghong
    [J]. 2019 IEEE 25TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2019, : 233 - 239
  • [9] NEW DIRECTIONS IN CRYPTOGRAPHY
    DIFFIE, W
    HELLMAN, ME
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1976, 22 (06) : 644 - 654
  • [10] Supporting Deep Neural Network Safety Analysis and Retraining Through Heatmap-Based Unsupervised Learning
    Fahmy, Hazem
    Pastore, Fabrizio
    Bagherzadeh, Mojtaba
    Briand, Lionel
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2021, 70 (04) : 1641 - 1657