A Platform for Diversity-Driven Test Amplification

被引:4
作者
Kessel, Marcus [1 ]
Atkinson, Colin [1 ]
机构
[1] Univ Mannheim, Mannheim, Germany
来源
PROCEEDINGS OF THE 10TH ACM SIGSOFT INTERNATIONAL WORKSHOP ON AUTOMATING TEST CASE DESIGN, SELECTION, AND EVALUATION (A-TEST '19) | 2019年
关键词
automated testing; test amplification; oracle problem; mining soft-ware repositories; behavior; observations; SOFTWARE;
D O I
10.1145/3340433.3342825
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Test amplification approaches take a manually written set of tests (input/output mappings) and enhance their effectiveness for some clearly defined engineering goal such as detecting faults. Conceptually, they can either achieve this in a "black box" way using only the initial "seed" tests or in a "white box" way utilizing additional inputs such as the source code or specification of the software under test. However, no fully black box approach to test amplification is currently available even though they can be used to enhance white box approaches. In this paper we introduce a new approach that uses the seed tests to search for existing redundant implementations of the software under test and leverages them as oracles in the generation and evaluation of new tests. The approach can therefore be used as a stand alone black box test amplification method or in tandem with other methods. In this paper we explain the approach, describe its synergies with other approaches and provide some evidence for its practical feasibility.
引用
收藏
页码:35 / 41
页数:7
相关论文
共 38 条
[1]   A Survey of Machine Learning for Big Code and Naturalness [J].
Allamanis, Miltiadis ;
Barr, Earl T. ;
Devanbu, Premkumar ;
Sutton, Charles .
ACM COMPUTING SURVEYS, 2018, 51 (04)
[2]  
Ammann P., 2008, INTRO SOFTWARE TESTI
[3]  
[Anonymous], 2019, GRADLE BUILD TOOL
[4]  
[Anonymous], 2007, P 22 IEEE ACM INT C
[5]  
[Anonymous], 2014, P 2014 INT S SOFTWAR
[6]   The Oracle Problem in Software Testing: A Survey [J].
Barr, Earl T. ;
Harman, Mark ;
McMinn, Phil ;
Shahbaz, Muzammil ;
Yoo, Shin .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2015, 41 (05) :507-525
[7]   The Plastic Surgery Hypothesis [J].
Barr, Earl T. ;
Brun, Yuriy ;
Devanbu, Premkumar ;
Harman, Mark ;
Sarro, Federica .
22ND ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (FSE 2014), 2014, :306-317
[8]  
Beckert B, 2014, IEEE INTELL SYST, V29, P20, DOI 10.1109/MIS.2014.3
[9]  
Boettiger Carl, 2015, ACM SIGOPS Operating Systems Review, V49, P71
[10]   Cross-Checking Oracles from Intrinsic Software Redundancy [J].
Carzaniga, Antonio ;
Goffi, Alberto ;
Gorla, Alessandra ;
Mattavelli, Andrea ;
Pezze, Mauro .
36TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2014), 2014, :931-942