TEST-INT: A Testing Platform for Deep Learning Models

被引:1
作者
Ozdemir, Ovgu [1 ]
Demir, Demet [1 ]
机构
[1] Proven Bilisim Teknol AS, ARGE Birimi, Ankara, Turkey
来源
2021 15TH TURKISH NATIONAL SOFTWARE ENGINEERING SYMPOSIUM (UYMS) | 2021年
关键词
deep learning; software testing; deep neural networks; data generation; test adequacy;
D O I
10.1109/UYMS54260.2021.9659790
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep learning models indicate remarkable performance in a wide variety of tasks especially in computer vision. However, it is often that deep learning models developed only perform well on a specific and limited test data, and fail in real-world applications. In safety-critical applications, it is highly significant deep learning model. The TEST-INT system, which we have produced to solve this problem, is a testing platform that creates new test sets from existing test data with different image transformation methods and adversarial attacks, as well as measures test adequacy and performance of the model, and reports them to the user.
引用
收藏
页码:155 / 157
页数:3
相关论文
共 16 条
[1]   Towards Evaluating the Robustness of Neural Networks [J].
Carlini, Nicholas ;
Wagner, David .
2017 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2017, :39-57
[2]  
David S, SELF DRIVING CAR, P2021
[3]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[4]   Fundamental Technologies in Modern Speech Recognition [J].
Furui, Sadaoki ;
Deng, Li ;
Gales, Mark ;
Ney, Hermann ;
Tokuda, Keiichi .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :16-17
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[6]  
Goodfellow Ian J., 2014, INT C LEARNING REPRE
[7]  
Hamel H, IMAGENETTE, P2021
[8]   Guiding Deep Learning System Testing Using Surprise Adequacy [J].
Kim, Jinhan ;
Feldt, Robert ;
Yoo, Shin .
2019 IEEE/ACM 41ST INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2019), 2019, :1039-1049
[9]  
Kurakin Alexey, 2017, INT C LEARN REPR
[10]   DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems [J].
Ma, Lei ;
Juefei-Xu, Felix ;
Zhang, Fuyuan ;
Sun, Jiyuan ;
Xue, Minhui ;
Li, Bo ;
Chen, Chunyang ;
Su, Ting ;
Li, Li ;
Liu, Yang ;
Zhao, Jianjun ;
Wang, Yadong .
PROCEEDINGS OF THE 2018 33RD IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMTED SOFTWARE ENGINEERING (ASE' 18), 2018, :120-131