Testability Transformations For Existing APIs

被引:17
作者
Arcuri, Andrea [1 ]
Galeotti, Juan P. [2 ]
机构
[1] Kristiana Univ Coll, Dept Technol, Oslo, Norway
[2] UBA, FCEyN, Dept Comp, ICC,CONICET, Buenos Aires, DF, Argentina
来源
2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020) | 2020年
关键词
SBST; test generation; testability transformation; system testing; REST; SOFTWARE;
D O I
10.1109/ICST46399.2020.00025
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Search-based software testing (SBST) has been shown to be an effective technique to generate test cases automatically. Its effectiveness strongly depends on the guidance of the fitness function. Unfortunately, a common issue in SBST is the so called flag problem, where the fitness landscape presents a plateau that provides no guidance. In this paper, we provide a series of novel testability transformations aimed at providing guidance in the context of commonly used API calls. An example is when strings need to be converted into valid date/time objects. We implemented our novel techniques as an extension to EVOMASTER, a SBST tool that generates system level test cases. Experiments on six open-source REST web services, and an industrial one, show that our novel techniques improve performance significantly.
引用
收藏
页码:153 / 163
页数:11
相关论文
共 27 条
[1]   A Systematic Review of the Application and Empirical Investigation of Search-Based Test Case Generation [J].
Ali, Shaukat ;
Briand, Lionel C. ;
Hemmati, Hadi ;
Panesar-Walawege, Rajwinder K. .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2010, 36 (06) :742-762
[2]   Deploying Search Based Software Engineering with Sapienz at Facebook [J].
Alshahwan, Nadia ;
Gao, Xinbo ;
Harman, Mark ;
Jia, Yue ;
Mao, Ke ;
Mols, Alexander ;
Tei, Taijin ;
Zorin, Ilya .
SEARCH-BASED SOFTWARE ENGINEERING, SSBSE 2018, 2018, 11036 :3-45
[3]   Search-based software test data generation for string data using program-specific search operators [J].
Alshraideh, Mohammad ;
Bottaci, Leonardo .
SOFTWARE TESTING VERIFICATION & RELIABILITY, 2006, 16 (03) :175-203
[4]  
[Anonymous], 2011, SIGSOFTFSE 11 19 ACM, DOI [DOI 10.1145/2025113.2025179, 10.1145/2025113.2025179]
[5]   RESTful API Automated Test Case Generation with EvoMaster [J].
Arcuri, Andrea .
ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2019, 28 (01)
[6]   EvoMaster: Evolutionary Multi-context Automated System Test Generation [J].
Arcuri, Andrea .
2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST), 2018, :394-397
[7]   A Hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering [J].
Arcuri, Andrea ;
Briand, Lionel .
SOFTWARE TESTING VERIFICATION & RELIABILITY, 2014, 24 (03) :219-250
[8]   It really does matter how you normalize the branch distance in search-based software testing [J].
Arcuri, Andrea .
SOFTWARE TESTING VERIFICATION & RELIABILITY, 2013, 23 (02) :119-147
[9]  
Baresel A., 2004, Software Engineering Notes, V29, P108, DOI 10.1145/1013886.1007527
[10]  
Baresel A, 2003, LECT NOTES COMPUT SC, V2724, P2442