PROVABLE IMPROVEMENTS ON BRANCH TESTING

被引:46
作者
FRANKL, PG
WEYUKER, EJ
机构
[1] NYU, COURANT INST MATH SCI, DEPT COMP SCI, NEW YORK, NY 10012 USA
[2] AT&T BELL LABS, SOFTWARE SYST RES CTR, MURRAY HILL, NJ 07974 USA
基金
美国国家航空航天局; 美国国家科学基金会;
关键词
CONDITION-COVERAGE TESTING; DATA FLOW TESTING; FAULT DETECTION; MUTATION TESTING; PROGRAM TESTING; SOFTWARE TESTING;
D O I
10.1109/32.245738
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper compares the fault-detecting ability of several software test data adequacy criteria. It has previously been shown that if C1 properly covers C2, then C1 is guaranteed to be better at detecting faults than C2, in the following sense: a test suite selected by independent random selection of one test case from each subdomain induced by C1 is at least as likely to detect a fault as a test suite similarly selected using C2. In contrast, if C1 subsumes but does not properly cover C2, this is not necessarily the case. These results are used to compare a number of criteria, including several that have been proposed as stronger alternatives to branch testing. We compare the relative fault-detecting ability of data How testing, mutation testing, and the condition-coverage techniques, to branch testing, showing that most of the criteria examined are guaranteed to be better than branch testing according to two probabilistic measures. We also show that there are criteria that can sometimes be poorer at detecting faults than substantially less expensive criteria.
引用
收藏
页码:962 / 975
页数:14
相关论文
共 25 条
  • [1] Budd T. A., 1981, Computer Program Testing. Proceedings of the Summer School on Computer Program Testing, P129
  • [2] CLARKE L, 1989, IEEE T SOFTWARE ENG, V15, P244
  • [3] Demillo R. A., 1993, ACM Transactions on Software Engineering and Methodology, V2, P109, DOI 10.1145/151257.151258
  • [4] HINTS ON TEST DATA SELECTION - HELP FOR PRACTICING PROGRAMMER
    DEMILLO, RA
    LIPTON, RJ
    [J]. COMPUTER, 1978, 11 (04) : 34 - 41
  • [5] AN EVALUATION OF RANDOM TESTING
    DURAN, JW
    NTAFOS, SC
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1984, 10 (04) : 438 - 444
  • [6] FOSDICK LD, 1976, COMPUT SURV, V8, P305, DOI 10.1145/356674.356676
  • [7] AN APPLICABLE FAMILY OF DATA FLOW TESTING CRITERIA
    FRANKL, PG
    WEYUKER, EJ
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1988, 14 (10) : 1483 - 1498
  • [8] A FORMAL ANALYSIS OF THE FAULT-DETECTING ABILITY OF TESTING METHODS
    FRANKL, PG
    WEYUKER, EJ
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1993, 19 (03) : 202 - 213
  • [9] FRANKL PG, 1993, PUCS10093 POL U COMP
  • [10] FRANKL PG, 1992, PUCS10092 POL U COMP