A Systematic Mapping Study of the Metrics, Uses and Subjects of Diversity-Based Testing Techniques

被引:0
作者
Elgendy, Islam T. [1 ]
Hierons, Robert M. [1 ]
Mcminn, Phil [1 ]
机构
[1] Univ Sheffield, Sch Comp Sci, Sheffield, England
关键词
diversity artefacts; diversity-based testing; diversity-based tools; fault localization; similarity-based testing; similarity metrics; test data generation; test case prioritization; test case selection; test suite reduction; TEST-CASE PRIORITIZATION; TEST-SUITE REDUCTION; FAULT LOCALIZATION; SELECTION; GENERATION;
D O I
10.1002/stvr.1914
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
There has been a significant amount of interest regarding the use of DBTtsfull in software testing over the past two decades. Diversity-based testing (DBT) technique uses similarity metrics to leverage the dissimilarity between software artefacts-such as requirements, abstract models, programme structures or inputs-in order to address a software testing problem. DBT techniques have been used to assist in finding solutions to several different types of problems including generating test cases, prioritizing them and reducing very large test suites. This paper is a systematic mapping study of DBT techniques that summarizes the key aspects and trends of 167 papers that report the use of 79 different similarity metrics with 22 different types of software artefacts, which have been used by researchers to tackle 11 different types of software testing problems. We further present an analysis of the recent trends in DBT techniques and review the different application domains to which the techniques have been applied, giving an overview of the tools developed by researchers in order to do so. Finally, the paper identifies some DBT challenges that are potential topics for future work, such as exploring other diversity artefacts and measuring diversity for complex data input.
引用
收藏
页数:45
相关论文
共 259 条
  • [1] Abd Halim S, 2019, J INF COMMUN TECHNOL, V18, P57
  • [2] Adigun J. G., 2023, RiskDriven Online Testing and Test Case Diversity Analysis for MlEnabled Critical Systems, P344, DOI [10.1109/ISSRE59848.2023.00017, DOI 10.1109/ISSRE59848.2023.00017]
  • [3] DeepGD: A Multi-Objective Black-Box Test Selection Approach for Deep Neural Networks
    Aghababaeyan, Zohreh
    Abdellatif, Manel
    Dadkhah, Mahboubeh
    Briand, Lionel
    [J]. ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2024, 33 (06)
  • [4] Black-Box Testing of Deep Neural Networks through Test Case Diversity
    Aghababaeyan, Zohreh
    Abdellatif, Manel
    Briand, Lionel
    Ramesh, S.
    Bagherzadeh, Mojtaba
    [J]. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2023, 49 (05) : 3182 - 3204
  • [5] Ahmad A., 2023, An Industrial Study on the Challenges and Effects of DiversityBased Testing in Continuous Integration, P337, DOI [10.1109/QRS60937.2023.00041, DOI 10.1109/QRS60937.2023.00041]
  • [6] Albunian N., 2020, Measuring and Maintaining Population Diversity in SearchBased Unit Test Generation, P153, DOI [10.1007/978-3-030-59762-711, DOI 10.1007/978-3-030-59762-711]
  • [7] Albunian N. M., 2017, Diversity in SearchBased Unit Test Suite Generation, P183, DOI [10.1007/978-3-319-66299-217, DOI 10.1007/978-3-319-66299-217]
  • [8] Almulla H., 2020, Generating Diverse Test Suites for GSON Through Adaptive Fitness Function Selection, P246, DOI [10.1007/978-3-030-59762-718, DOI 10.1007/978-3-030-59762-718]
  • [9] Alpha W., Euclidean Distance Wolfram: Alpha
  • [10] Alpha W., Manhattan Distance Wolfram: Alpha