On the Correlation between the Effectiveness of Metamorphic Relations and Dissimilarities of Test Case Executions

被引：36
作者：
Cao, Yuxiang [1 ]
Zhou, Zhi Quan [1 ]
Chen, Tsong Yueh [2 ]
机构：
[1] Univ Wollongong, Sch Comp Sci & Software Engn, Wollongong, NSW 2522, Australia
[2] Swinburne Univ Technol, Hawthorn, Vic 3122, Australia
来源：
2013 13TH INTERNATIONAL CONFERENCE ON QUALITY SOFTWARE (QSIC) | 2013年
基金：
澳大利亚研究理事会;
关键词：
Software testing; metamorphic testing; metamorphic relation; fault-detection effectiveness; execution dissimilarity; distance measurement; initial execution; follow-up execution;
D O I：
10.1109/QSIC.2013.43
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
Metamorphic testing (MT) is a property-based automated software testing method. It alleviates the oracle problem by testing programs against metamorphic relations (MRs), which are necessary properties among multiple executions of the target program. For a given problem, usually more than one MR can be identified. It is therefore of practical importance for testers to know the nature of good MRs, that is, which MRs are likely to have higher chances of revealing failures. To address this issue we investigate the correlation between the fault-detection effectiveness of MRs and the dissimilarity (distance) of test case execution profiles. Empirical study results reveal that there is a strong and statistically significant positive correlation between the fault-detection effectiveness and the distance. The findings of this research can help to develop automated means of selecting/prioritizing MRs for cost-effective metamorphic testing.
引用
收藏
页码：153 / 162
页数：10
相关论文
共 22 条
  • [1] Asrafi M., 2011, Proceedings of the 2011 Fifth International Conference on Secure Software Integration and Reliability Improvement (SSIRI 2011), P147, DOI 10.1109/SSIRI.2011.21
  • [2] SELF-TESTING CORRECTING WITH APPLICATIONS TO NUMERICAL PROBLEMS
    BLUM, M
    LUBY, M
    RUBINFELD, R
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1993, 47 (03) : 549 - 595
  • [3] Blum M., 1989, Proceedings of the Twenty First Annual ACM Symposium on Theory of Computing, P86, DOI 10.1145/73007.73015
  • [4] Cai KY, 2004, ELEVENTH ANNUAL INTERNATIONAL WORKSHOP ON SOFTWARE TECHNOLOGY AND ENGINEERING PRACTICE, PROCEEDINGS, P77
  • [5] Chen T. Y., 2002, Software Engineering Notes, V27, P191, DOI 10.1145/566171.566202
  • [6] Chen T.Y., 2004, PROC 4 IBERO AM S SO, P569
  • [7] Metamorphic Testing: Applications and Integration with Other Methods
    Chen, Tsong Yueh
    Kuo, Fei-Ching
    Towey, Dave
    Zhou, Zhi Quan
    [J]. 2012 12TH INTERNATIONAL CONFERENCE ON QUALITY SOFTWARE (QSIC), 2012, : 285 - 288
  • [8] Semi-Proving: An Integrated Method for Program Proving, Testing, and Debugging
    Chen, Tsong Yueh
    Tse, T. H.
    Zhou, Zhi Quan
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2011, 37 (01) : 109 - 125
  • [9] Fault-based testing without the need of oracles
    Chen, TY
    Tse, TH
    Zhou, ZQ
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2003, 45 (01) : 1 - 9
  • [10] Finding failures by cluster analysis of execution profiles
    Dickinson, W
    Leon, D
    Podgurski, A
    [J]. PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, 2001, : 339 - 348
123