Distributed Repair of Deep Neural Networks

被引:10
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Polytech Univ Milan, Milan, Italy
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST | 2023年
关键词
DNNs; automated repair; risk levels;
D O I
10.1109/ICST57152.2023.00017
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep Neural Networks (DNNs) are applied in several safety-critical domains and their trustworthiness is of paramount importance. For example, DNNs used in autonomous driving as classifiers should not misclassify detected objects; however, since obtaining perfect accuracy is not possible, special attention should be given to the most critical cases, e.g., pedestrians. This has been confirmed by the consortium of our partners from the automotive domain that provided us with specific risk levels for different misclassifications. A recent approach to improve DNN performance is to localise DNN weights responsible for the misclassifications and then adjust (repair) them to improve the misclassifications. However, they under-perform when they need to consider multiple misclassifications, and they do not consider the risk levels of the different misclassifications. To tackle this, we propose DISTRREP, a distributed repair approach that first finds the best fixes for each critical misclassification, and then integrates them in a single repaired DNN model, by considering the risk levels. We assess DISTRREP over three DNN models and a dataset of autonomous driving images, by considering requirements specified by our industrial partners. Experiments show that DISTRREP is more effective than baseline approaches based on retraining, and other risk-unaware repair approaches.
引用
收藏
页码:83 / 94
页数:12
相关论文
共 46 条
[41]   DeepRepair: Style-Guided Repairing for Deep Neural Networks in the Real-World Operational Environment [J].
Yu, Bing ;
Qi, Hua ;
Qing, Guo ;
Juefei-Xu, Felix ;
Xie, Xiaofei ;
Ma, Lei ;
Zhao, Jianjun .
IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (04) :1401-1416
[42]   BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning [J].
Yu, Fisher ;
Chen, Haofeng ;
Wang, Xin ;
Xian, Wenqi ;
Chen, Yingying ;
Liu, Fangchen ;
Madhavan, Vashisht ;
Darrell, Trevor .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2633-2642
[43]   Multiple fault localization of software programs: A systematic literature review [J].
Zakari, Abubakar ;
Lee, Sai Peck ;
Abreu, Rui ;
Ahmed, Babiker Hussien ;
Rasheed, Rasheed Abubakar .
INFORMATION AND SOFTWARE TECHNOLOGY, 2020, 124
[44]   Apricot: A Weight-Adaptation Approach to Fixing Deep Learning Models [J].
Zhang, Hao ;
Chan, W. K. .
34TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2019), 2019, :376-387
[45]   Machine Learning Testing: Survey, Landscapes and Horizons [J].
Zhang, Jie M. ;
Harman, Mark ;
Ma, Lei ;
Liu, Yang .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2022, 48 (01) :1-36
[46]   DEEPHYPERION: Exploring the Feature Space of Deep Learning-Based Systems through Illumination Search [J].
Zohdinasab, Tahereh ;
Riccio, Vincenzo ;
Gambi, Alessio ;
Tonella, Paolo .
ISSTA '21: PROCEEDINGS OF THE 30TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, 2021, :79-90