Adaptive Search-based Repair of Deep Neural Networks

被引:10
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Laurent, Thomas [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023 | 2023年
关键词
Deep Neural Networks; DNN Repair; Search-Based Software Engineering; Fault Localisation; LOCALIZATION;
D O I
10.1145/3583131.3590477
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep Neural Networks (DNNs) are finding a place at the heart of more and more critical systems, and it is necessary to ensure they perform in as correct a way as possible. Search-based repair methods, that search for new values for target neuron weights in the network to better process fault-inducing inputs, have shown promising results. These methods rely on fault localisation to determine what weights the search should target. However, as the search progresses and the network evolves, the weights responsible for the faults in the system will change, and the search will lose in effectiveness. In this work, we propose an adaptive search method for DNN repair that adaptively updates the target weights during the search by performing fault localisation on the current state of the model. We propose and implement two methods to decide when to update the target weights, based on the progress of the search's fitness value or on the evolution of fault localisation results. We apply our technique to two image classification DNN architectures against a dataset of autonomous driving images, and compare it with a state-of-the art search-based DNN repair approach.
引用
收藏
页码:1527 / 1536
页数:10
相关论文
共 49 条
[41]   A Survey on Software Fault Localization [J].
Wong, W. Eric ;
Gao, Ruizhi ;
Li, Yihao ;
Abreu, Rui ;
Wotawa, Franz .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2016, 42 (08) :707-740
[42]   The DStar Method for Effective Software Fault Localization [J].
Wong, W. Eric ;
Debroy, Vidroha ;
Gao, Ruizhi ;
Li, Yihao .
IEEE TRANSACTIONS ON RELIABILITY, 2014, 63 (01) :290-308
[43]   A Theoretical Analysis of the Risk Evaluation Formulas for Spectrum-Based Fault Localization [J].
Xie, Xiaoyuan ;
Chen, Tsong Yueh ;
Kuo, Fei-Ching ;
Xu, Baowen .
ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2013, 22 (04)
[44]   Human Competitiveness of Genetic Programming in Spectrum-Based Fault Localisation: Theoretical and Empirical Analysis [J].
Yoo, Shin ;
Xie, Xiaoyuan ;
Kuo, Fei-Ching ;
Chen, Tsong Yueh ;
Harman, Mark .
ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2017, 26 (01)
[45]   BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning [J].
Yu, Fisher ;
Chen, Haofeng ;
Wang, Xin ;
Xian, Wenqi ;
Chen, Yingying ;
Liu, Fangchen ;
Madhavan, Vashisht ;
Darrell, Trevor .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2633-2642
[46]   Apricot: A Weight-Adaptation Approach to Fixing Deep Learning Models [J].
Zhang, Hao ;
Chan, W. K. .
34TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2019), 2019, :376-387
[47]   Machine Learning Testing: Survey, Landscapes and Horizons [J].
Zhang, Jie M. ;
Harman, Mark ;
Ma, Lei ;
Liu, Yang .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2022, 48 (01) :1-36
[48]  
Zhou J, 2012, PROC INT CONF SOFTW, P14, DOI 10.1109/ICSE.2012.6227210
[49]   An Empirical Study of Fault Localization Families and Their Combinations [J].
Zou, Daming ;
Liang, Jingjing ;
Xiong, Yingfei ;
Ernst, Michael D. ;
Zhang, Lu .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2021, 47 (02) :332-347