Adaptive random testing based on distribution metrics

被引:35
作者
Chen, Tsong Yueh [1 ]
Kuo, Fei-Ching [1 ]
Liu, Huai [1 ]
机构
[1] Swinburne Univ Technol, Fac Informat & Commun Technol, Hawthorn, Vic 3122, Australia
基金
澳大利亚研究理事会;
关键词
Software testing; Random testing; Adaptive random testing; Test case distribution; Discrepancy; Dispersion;
D O I
10.1016/j.jss.2009.05.017
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Random testing (RT) is a fundamental software testing technique. Adaptive random testing (ART), an enhancement of RT, generally uses fewer test cases than RT to detect the first failure. ART generates test cases in a random manner, together with additional test case selection criteria to enforce that the executed test cases are evenly spread over the input domain. Some studies have been conducted to measure how evenly an ART algorithm can spread its test cases with respect to some distribution metrics. These studies observed that there exists a correlation between the failure detection capability and the evenness of test case distribution. Inspired by this observation, we aim to study whether failure detection capability of ART can be enhanced by using distribution metrics as criteria for the test case selection process. Our simulations and empirical results show that the newly proposed algorithms not only improve the evenness of test case distribution, but also enhance the failure detection capability of ART. (C) 2009 Elsevier Inc. All rights reserved.
引用
收藏
页码:1419 / 1433
页数:15
相关论文
共 44 条
[1]  
ACM, 1980, COLL ALG ACM
[2]   DATA DIVERSITY - AN APPROACH TO SOFTWARE FAULT TOLERANCE [J].
AMMANN, PE ;
KNIGHT, JC .
IEEE TRANSACTIONS ON COMPUTERS, 1988, 37 (04) :418-425
[3]  
[Anonymous], 1992, Numerical recipes in C: The Art of Scientific Computing
[4]  
[Anonymous], 1990, Software Testing Techniques
[5]  
[Anonymous], 2002, 7007011 RTI NAT I ST
[6]   AUTOMATIC-GENERATION OF RANDOM SELF-CHECKING TEST CASES [J].
BIRD, DL ;
MUNOZ, CU .
IBM SYSTEMS JOURNAL, 1983, 22 (03) :229-245
[7]  
Bishop P. G., 1993, P 23 INT S FAULT TOL, P98
[8]  
Branicky MS, 2001, IEEE INT CONF ROBOT, P1481, DOI 10.1109/ROBOT.2001.932820
[9]  
Budd T. A., 1981, Computer Program Testing. Proceedings of the Summer School on Computer Program Testing, P129
[10]   Restricted random testing: Adaptive random testing by exclusion [J].
Chan, Kwok Ping ;
Chen, Tsong Yueh ;
Towey, Dave .
INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2006, 16 (04) :553-584