Coverage-Based Test Case Prioritisation: An Industrial Case Study

被引：34
作者：
Di Nardo, Daniel [1 ]
Alshahwan, Nadia [1 ]
Briand, Lionel [1 ]
Labiche, Yvan [2 ]
机构：
[1] Univ Luxembourg, Interdisciplinary Ctr Secur Reliabil & Trust, Luxembourg, Luxembourg
[2] Carleton Univ, Syst & Comp Engn, Software Qual Engn Lab, Ottawa, ON, Canada
来源：
2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2013) | 2013年
基金：
加拿大自然科学与工程研究理事会;
关键词：
regression testing; industrial case study; test case prioritisation; MINIMIZATION;
D O I：
10.1109/ICST.2013.27
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
This paper presents an industrial case study of coverage-based prioritisation techniques on a real world system with real regression faults. The study evaluates four common and different test case prioritisation techniques and examines the effects of using various coverage criteria on the fault detection rates of the prioritised test suites. The results show that prioritisation techniques that are based on additional coverage with finer grained coverage criteria perform significantly better in fault detection rates. The study also reveals that using modification information does not significantly enhance fault detection rates.
引用
收藏
页码：302 / 311
页数：10
相关论文
共 23 条
  • [1] A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering
    Arcuri, Andrea
    Briand, Lionel
    [J]. 2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2011, : 1 - 10
  • [2] Carlson Ryan, 2011, 2011 IEEE 27th International Conference on Software Maintenance, P382, DOI 10.1109/ICSM.2011.6080805
  • [3] Do H, 2005, PROC IEEE INT CONF S, P411
  • [4] Do H, 2004, 2004 INTERNATIONAL SYMPOSIUM ON EMPIRICAL SOFTWARE ENGINEERING, PROCEEDINGS, P60
  • [5] Do HS, 2004, 15TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, PROCEEDINGS, P113
  • [6] Selecting a cost-effective test case prioritization technique
    Elbaum, S
    Rothermel, G
    Kanduri, S
    Malishevsky, AG
    [J]. SOFTWARE QUALITY JOURNAL, 2004, 12 (03) : 185 - 210
  • [7] Understanding the effects of changes on the cost-effectiveness of regression testing techniques
    Elbaum, S
    Kallakuri, P
    Malishevsky, A
    Rothermel, G
    Kanduri, S
    [J]. SOFTWARE TESTING VERIFICATION & RELIABILITY, 2003, 13 (02) : 65 - 83
  • [8] Test case prioritization: A family of empirical studies
    Elbaum, S
    Malishevsky, AG
    Rothermel, G
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2002, 28 (02) : 159 - 182
  • [9] Incorporating varying test costs and fault severities into test case prioritization
    Elbaum, S
    Malishevsky, A
    Rothermel, G
    [J]. PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, 2001, : 329 - 338
  • [10] Engstrom E., 2011, Proceedings 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation (ICST 2011), P367, DOI 10.1109/ICST.2011.27
123