A Theoretical and Empirical Analysis of the Role of Test Sequence Length in Software Testing for Structural Coverage

被引:19
作者
Arcuri, Andrea [1 ]
机构
[1] Simula Res Lab, N-1325 Lysaker, Norway
关键词
Evolutionary testing; object-oriented software; state problem; search-based software engineering; software testing; length; test sequence; RUNTIME ANALYSIS;
D O I
10.1109/TSE.2011.44
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the presence of an internal state, often a sequence of function calls is required to test software. In fact, to cover a particular branch of the code, a sequence of previous function calls might be required to put the internal state in the appropriate configuration. Internal states are not only present in object-oriented software, but also in procedural software (e. g., static variables in C programs). In the literature, there are many techniques to test this type of software. However, to the best of our knowledge, the properties related to the choice of the length of these sequences have received only a little attention in the literature. In this paper, we analyze the role that the length plays in software testing, in particular branch coverage. We show that, on "difficult" software testing benchmarks, longer test sequences make their testing trivial. Hence, we argue that the choice of the length of the test sequences is very important in software testing. Theoretical analyses and empirical studies on widely used benchmarks and on an industrial software are carried out to support our claims.
引用
收藏
页码:497 / 519
页数:23
相关论文
共 39 条
[1]  
Andrews James H., 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering, P19, DOI 10.1109/ASE.2008.12
[2]  
[Anonymous], CSR0904 U BIRM
[3]  
[Anonymous], 2010, Proceedings of the 19th International Symposium on Software Testing and Analysis, ISSTA'10
[4]  
Arcuri Andrea, 2010, Proceedings of the Third IEEE International Conference on Software Testing, Verification and Validation (ICST 2010), P205, DOI 10.1109/ICST.2010.17
[5]  
Arcuri Andrea, 2008, 2008 IEEE International Conference on Software Testing Verification and Validation Workshop (ICSTW), P161, DOI 10.1109/ICSTW.2008.48
[6]  
Arcuri A., 2009, GECCO '09: Proceedings of the 11th Annual Conf. on Genetic and evolutionary computation, P1649
[7]  
Arcuri A., 2010, P IFIP INT C TEST SO
[8]   Search based software testing of object-oriented containers [J].
Arcuri, Andrea ;
Yao, Xin .
INFORMATION SCIENCES, 2008, 178 (15) :3075-3095
[9]  
Arcuri A, 2009, LECT NOTES COMPUT SC, V5792, P156, DOI 10.1007/978-3-642-04944-6_13
[10]   Full Theoretical Runtime Analysis of Alternating Variable Method on the Triangle Classification Problem [J].
Arcuri, Andrea .
1ST INTERNATIONAL SYMPOSIUM ON SEARCH BASED SOFTWARE ENGINEERING, PROCEEDINGS, 2009, :113-121