Adaptive Search-based Repair of Deep Neural Networks

被引:10
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Laurent, Thomas [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023 | 2023年
关键词
Deep Neural Networks; DNN Repair; Search-Based Software Engineering; Fault Localisation; LOCALIZATION;
D O I
10.1145/3583131.3590477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep Neural Networks (DNNs) are finding a place at the heart of more and more critical systems, and it is necessary to ensure they perform in as correct a way as possible. Search-based repair methods, that search for new values for target neuron weights in the network to better process fault-inducing inputs, have shown promising results. These methods rely on fault localisation to determine what weights the search should target. However, as the search progresses and the network evolves, the weights responsible for the faults in the system will change, and the search will lose in effectiveness. In this work, we propose an adaptive search method for DNN repair that adaptively updates the target weights during the search by performing fault localisation on the current state of the model. We propose and implement two methods to decide when to update the target weights, based on the progress of the search's fitness value or on the evolution of fault localisation results. We apply our technique to two image classification DNN architectures against a dataset of autonomous driving images, and compare it with a state-of-the art search-based DNN repair approach.
引用
收藏
页码:1527 / 1536
页数:10
相关论文
共 49 条
[1]  
Abreu R, 2006, 12TH PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING, PROCEEDINGS, P39
[2]   A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering [J].
Arcuri, Andrea ;
Briand, Lionel .
2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, :1-10
[3]   Spectrum-based fault localization in software product lines [J].
Arrieta, Aitor ;
Segura, Sergio ;
Markiegi, Urtzi ;
Sagardui, Goiuria ;
Etxeberria, Leire .
INFORMATION AND SOFTWARE TECHNOLOGY, 2018, 100 :18-31
[4]  
Bojarski M, 2016, Arxiv, DOI [arXiv:1604.07316, DOI 10.48550/ARXIV.1604.07316]
[5]   Distributed Repair of Deep Neural Networks [J].
Calsi, Davide Li ;
Duran, Matias ;
Zhang, Xiao-Yi ;
Arcaini, Paolo ;
Ishikawa, Fuyuki .
2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2023, :83-94
[6]  
Calsi Davide Li, 2023, MAT PAPER ADAPTIVE S
[7]   DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs [J].
Cao, Jialun ;
Li, Meiziniu ;
Chen, Xiao ;
Wen, Ming ;
Tian, Yongqiang ;
Wu, Bo ;
Cheung, Shing-Chi .
2022 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2022), 2022, :573-585
[8]  
Cohen D, 2022, Arxiv, DOI arXiv:2207.08157
[9]   Generating Fixes from Object Behavior Anomalies [J].
Dallmeier, Valentin ;
Zeller, Andreas ;
Meyer, Bertrand .
2009 IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, PROCEEDINGS, 2009, :550-554
[10]   Leveraging Program Invariants to Promote Population Diversity in Search-Based Automatic Program Repair [J].
Ding, Zhen Yu ;
Lyu, Yiwei ;
Timperley, Christopher ;
Le Goues, Claire .
2019 IEEE/ACM 6TH INTERNATIONAL WORKSHOP ON GENETIC IMPROVEMENT (GI@ICSE 2019), 2019, :2-9