Distributed Repair of Deep Neural Networks

被引:10
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Polytech Univ Milan, Milan, Italy
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
来源
2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST | 2023年
关键词
DNNs; automated repair; risk levels;
D O I
10.1109/ICST57152.2023.00017
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep Neural Networks (DNNs) are applied in several safety-critical domains and their trustworthiness is of paramount importance. For example, DNNs used in autonomous driving as classifiers should not misclassify detected objects; however, since obtaining perfect accuracy is not possible, special attention should be given to the most critical cases, e.g., pedestrians. This has been confirmed by the consortium of our partners from the automotive domain that provided us with specific risk levels for different misclassifications. A recent approach to improve DNN performance is to localise DNN weights responsible for the misclassifications and then adjust (repair) them to improve the misclassifications. However, they under-perform when they need to consider multiple misclassifications, and they do not consider the risk levels of the different misclassifications. To tackle this, we propose DISTRREP, a distributed repair approach that first finds the best fixes for each critical misclassification, and then integrates them in a single repaired DNN model, by considering the risk levels. We assess DISTRREP over three DNN models and a dataset of autonomous driving images, by considering requirements specified by our industrial partners. Experiments show that DISTRREP is more effective than baseline approaches based on retraining, and other risk-unaware repair approaches.
引用
收藏
页码:83 / 94
页数:12
相关论文
共 46 条
[1]  
Abreu R, 2006, 12TH PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING, PROCEEDINGS, P39
[2]  
[Anonymous], 2022, ISO 21448:2022
[3]   A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering [J].
Arcuri, Andrea ;
Briand, Lionel .
2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, :1-10
[4]  
Bojarski Mariusz, 2016, arXiv
[5]   DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs [J].
Cao, Jialun ;
Li, Meiziniu ;
Chen, Xiao ;
Wen, Ming ;
Tian, Yongqiang ;
Wu, Bo ;
Cheung, Shing-Chi .
2022 ACM/IEEE 44TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2022), 2022, :573-585
[6]  
Clerc M., 2010, P ICNN 95 INT C NEUR, V93, DOI DOI 10.1109/ICNN.1995.488968
[7]  
Cohen D, 2022, Arxiv, DOI arXiv:2207.08157
[8]   What to Blame? On the Granularity of Fault Localization for Deep Neural Networks [J].
Duran, Matias ;
Zhang, Xiao-Yi ;
Arcaini, Paolo ;
Ishikawa, Fuyuki .
2021 IEEE 32ND INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE 2021), 2021, :264-275
[9]   DeepFault: Fault Localization for Deep Neural Networks [J].
Eniser, Hasan Ferit ;
Gerasimou, Simos ;
Sen, Alper .
FUNDAMENTAL APPROACHES TO SOFTWARE ENGINEERING (FASE 2019), 2019, 11424 :171-191
[10]   Supporting Deep Neural Network Safety Analysis and Retraining Through Heatmap-Based Unsupervised Learning [J].
Fahmy, Hazem ;
Pastore, Fabrizio ;
Bagherzadeh, Mojtaba ;
Briand, Lionel .
IEEE TRANSACTIONS ON RELIABILITY, 2021, 70 (04) :1641-1657