Parallel mutation testing for large scale systems

被引:1
作者
Canizares, Pablo C. [1 ]
Nunez, Alberto [2 ]
Filgueira, Rosa [3 ]
de Lara, Juan [1 ]
机构
[1] Autonomous Univ Madrid, Comp Sci Dept, Madrid, Spain
[2] Univ Complutense Madrid, Software Syst & Computat Dept, Madrid, Spain
[3] Univ St Andrews, Sch Comp Sci, St Andrews, Scotland
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2024年 / 27卷 / 02期
关键词
Mutation testing; Parallel mutation testing; Large scale systems; High performance computing; Distributed systems; Testing; COST REDUCTION; CLOUD; FRAMEWORK; PROGRAMS;
D O I
10.1007/s10586-023-04074-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mutation testing is a valuable technique for measuring the quality of test suites in terms of detecting faults. However, one of its main drawbacks is its high computational cost. For this purpose, several approaches have been recently proposed to speed-up the mutation testing process by exploiting computational resources in distributed systems. However, bottlenecks have been detected when those techniques are applied in large-scale systems. This work improves the performance of mutation testing using large-scale systems by proposing a new load distribution algorithm, and parallelising different steps of the process. To demonstrate the benefits of our approach, we report on a thorough empirical evaluation, which analyses and compares our proposal with existing solutions executed in large-scale systems. The results show that our proposal outperforms the state-of-the-art distribution algorithms up to 35% in three different scenarios, reaching a reduction of the execution time of-at best-up to 99.66%.
引用
收藏
页码:2071 / 2097
页数:27
相关论文
共 50 条
  • [1] Parallel mutation testing for large scale systems
    Pablo C. Cañizares
    Alberto Núñez
    Rosa Filgueira
    Juan de Lara
    Cluster Computing, 2024, 27 : 2071 - 2097
  • [2] Parallel mutation testing
    Reales Mateo, Pedro
    Polo Usaola, Macario
    SOFTWARE TESTING VERIFICATION & RELIABILITY, 2013, 23 (04) : 315 - 350
  • [3] Large electromagnetic simulation by hybrid approach on large-scale parallel computing systems
    Alexandru, Mihai
    Monteil, Thierry
    Lorenz, Petr
    Coccetti, Fabio
    Aubert, Herve
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (13) : 3184 - 3204
  • [4] Integration and Testing of Large Scale Diagnostic Systems
    Plewinski, Pawel
    Makowski, Dariusz
    Perek, Piotr
    Napieralski, Andrzej
    PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE MIXED DESIGN OF INTEGRATED CIRCUITS AND SYSTEM (MIXDES 2018), 2018, : 85 - 88
  • [5] EMINENT: EMbarrassINgly parallEl mutatioN Testing
    Canizares, Pablo C.
    Merayo, Mercedes G.
    Nunez, Alberto
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE 2016 (ICCS 2016), 2016, 80 : 63 - 73
  • [6] Practical Mutation Testing at Scale: A view from Google
    Petrovic, Goran
    Ivankovic, Marko
    Fraser, Gordon
    Just, Rene
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2022, 48 (10) : 3900 - 3912
  • [7] Mitigating I/O Impact of Checkpointing on Large Scale Parallel Systems
    Wang, Nana
    Sun, Qingzheng
    Liu, Yi
    Qian, Depei
    IEEE 20TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS / IEEE 16TH INTERNATIONAL CONFERENCE ON SMART CITY / IEEE 4TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (HPCC/SMARTCITY/DSS), 2018, : 117 - 123
  • [8] A Survey on Load Testing of Large-Scale Software Systems
    Jiang, Zhen Ming
    Hassan, Ahmed E.
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2015, 41 (11) : 1091 - 1118
  • [9] Software Testing Techniques for Parallel Systems: A Survey
    Alghamdi, Ahmed M.
    Eassa, Fathy E.
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2019, 19 (04): : 176 - 186
  • [10] Exploratory Testing of Large-Scale Systems - Testing in the Continuous Integration and Delivery Pipeline
    Martensson, Torvald
    Stahl, Daniel
    Bosch, Jan
    PRODUCT-FOCUSED SOFTWARE PROCESS IMPROVEMENT (PROFES 2017), 2017, 10611 : 368 - 384