Efficient Computation of Robustness of Convolutional Neural Networks

被引:1
作者
Arcaini, Paolo [1 ]
Bombarda, Andrea [2 ]
Bonfanti, Silvia [2 ]
Gargantini, Angelo [2 ]
机构
[1] Natl Inst Informat, Tokyo, Japan
[2] Univ Bergamo, Bergamo, Italy
来源
THIRD IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING (AITEST 2021) | 2021年
关键词
Convolutional Neural Networks; robustness; efficient robustness computation; image classification; alteration; CLASSIFICATION; REDUCTION;
D O I
10.1109/AITEST52744.2021.00015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Validation of CNNs is extremely important, especially when they are used in safety-critical domains. In particular, in the latest years, the focus of validation has been put on assessing the robustness of CNNs, i.e., their ability to correctly classify perturbed input data. A way to measure robustness is to check the network accuracy over many datasets obtained by altering the input data in different ways, but this is time and resource-consuming. In this paper, we present ASAP, a method to efficiently compute the robustness of a CNN, exploiting a parabola-based approximation which allows to adaptively select only relevant alteration levels. The method is tested on two different benchmarks (MNIST and breast cancer classification). Moreover, we compare ASAP with other techniques based on uniform sampling, numerical integration, and random sampling.
引用
收藏
页码:21 / 28
页数:8
相关论文
共 20 条
[1]   State-of-the-art in artificial neural network applications: A survey [J].
Abiodun, Oludare Isaac ;
Jantan, Aman ;
Omolara, Abiodun Esther ;
Dada, Kemi Victoria ;
Mohamed, Nachaat AbdElatif ;
Arshad, Humaira .
HELIYON, 2018, 4 (11)
[2]  
[Anonymous], MNIST DATABASE HANDW
[3]  
[Anonymous], HANDWRITTEN DIGIT RE
[4]   ROBY: a Tool for Robustness Analysis of Neural Network Classifiers [J].
Arcaini, Paolo ;
Bombarda, Andrea ;
Bonfanti, Silvia ;
Gargantini, Angelo .
2021 14TH IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2021), 2021, :442-447
[5]   Dealing with Robustness of Convolutional Neural Networks for Image Classification [J].
Arcaini, Paolo ;
Bombarda, Andrea ;
Bonfanti, Silvia ;
Gargantini, Angelo .
2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING (AITEST), 2020, :7-14
[6]  
Boopathy A, 2019, AAAI CONF ARTIF INTE, P3240
[7]   A data reduction method to train, test, and validate neural networks [J].
Colmenares, G ;
Perez, R .
PROCEEDINGS IEEE SOUTHEASTCON '98: ENGINEERING FOR A NEW ERA, 1998, :277-280
[8]   Bioinformatical identification of key pathways and genes in human hepatocellular carcinoma after CSN5 depletion [J].
Fu, Qiang ;
Yang, Fan ;
Zhao, Ji ;
Yang, Xingxing ;
Xiang, Tengxiao ;
Huai, Guoli ;
Zhang, Jiashu ;
Wei, Liang ;
Deng, Shaoping ;
Yang, Hongji .
CELLULAR SIGNALLING, 2018, 49 :79-86
[9]   Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance [J].
Fu, XJ ;
Wang, LP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2003, 33 (03) :399-409
[10]   Deep learning-based image recognition for autonomous driving [J].
Fujiyoshi, Hironobu ;
Hirakawa, Tsubasa ;
Yamashita, Takayoshi .
IATSS RESEARCH, 2019, 43 (04) :244-252