Parallel mutation testing for large scale systems

被引:1
|
作者
Canizares, Pablo C. [1 ]
Nunez, Alberto [2 ]
Filgueira, Rosa [3 ]
de Lara, Juan [1 ]
机构
[1] Autonomous Univ Madrid, Comp Sci Dept, Madrid, Spain
[2] Univ Complutense Madrid, Software Syst & Computat Dept, Madrid, Spain
[3] Univ St Andrews, Sch Comp Sci, St Andrews, Scotland
来源
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS | 2024年 / 27卷 / 02期
关键词
Mutation testing; Parallel mutation testing; Large scale systems; High performance computing; Distributed systems; Testing; COST REDUCTION; CLOUD; FRAMEWORK; PROGRAMS;
D O I
10.1007/s10586-023-04074-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mutation testing is a valuable technique for measuring the quality of test suites in terms of detecting faults. However, one of its main drawbacks is its high computational cost. For this purpose, several approaches have been recently proposed to speed-up the mutation testing process by exploiting computational resources in distributed systems. However, bottlenecks have been detected when those techniques are applied in large-scale systems. This work improves the performance of mutation testing using large-scale systems by proposing a new load distribution algorithm, and parallelising different steps of the process. To demonstrate the benefits of our approach, we report on a thorough empirical evaluation, which analyses and compares our proposal with existing solutions executed in large-scale systems. The results show that our proposal outperforms the state-of-the-art distribution algorithms up to 35% in three different scenarios, reaching a reduction of the execution time of-at best-up to 99.66%.
引用
收藏
页码:2071 / 2097
页数:27
相关论文
共 50 条
  • [21] A large-scale study of call graph-based impact prediction using mutation testing
    Vincenzo Musco
    Martin Monperrus
    Philippe Preux
    Software Quality Journal, 2017, 25 : 921 - 950
  • [22] APPLICATION OF A JAVA']JAVA-BASED FRAMEWORK TO PARALLEL SIMULATION OF LARGE-SCALE SYSTEMS
    Niewiadomska-Szynkiewicz, Ewa
    Zmuda, Maciej
    Malinowski, Krzysztof
    INTERNATIONAL JOURNAL OF APPLIED MATHEMATICS AND COMPUTER SCIENCE, 2003, 13 (04) : 537 - 547
  • [23] Parallel Domain Decomposition Based Distributed State Estimation for Large-scale Power Systems
    Karimipour, Hadis
    Dinavahi, Venkata
    2015 IEEE/IAS 51ST INDUSTRIAL & COMMERCIAL POWER SYSTEMS TECHNICAL CONFERENCE (I&CPS), 2015,
  • [24] Towards mutation testing of Reinforcement Learning systems
    Lu, Yuteng
    Sun, Weidi
    Sun, Meng
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 131
  • [25] LittleDarwin: A Feature-Rich and Extensible Mutation Testing Framework for Large and Complex Java']Java Systems
    Parsai, Ali
    Murgia, Alessandro
    Demeyer, Serge
    FUNDAMENTALS OF SOFTWARE ENGINEERING, FSEN 2017, 2017, 10522 : 148 - 163
  • [26] Job Characteristics on Large-Scale Systems: Long-Term Analysis, Quantification, and Implications
    Patel, Tirthak
    Liu, Zhengchun
    Kettimuthu, Raj
    Rich, Paul
    Allcock, William
    Tiwari, Devesh
    PROCEEDINGS OF SC20: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC20), 2020,
  • [27] DeepMutation: Mutation Testing of Deep Learning Systems
    Ma, Lei
    Zhang, Fuyuan
    Sun, Jiyuan
    Xue, Minhui
    Li, Bo
    Juefei-Xu, Felix
    Xie, Chao
    Li, Li
    Liu, Yang
    Zhao, Jianjun
    Wang, Yadong
    2018 29TH IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE), 2018, : 100 - 111
  • [28] Delta-oriented model-based integration testing of large-scale systems
    Lochau, Malte
    Lity, Sascha
    Lachmann, Remo
    Schaefer, Ina
    Goltz, Ursula
    JOURNAL OF SYSTEMS AND SOFTWARE, 2014, 91 : 63 - 84
  • [29] Parallel Domain-Decomposition-Based Distributed State Estimation for Large-Scale Power Systems
    Karimipour, Hadis
    Dinavahi, Venkata
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2016, 52 (02) : 1265 - 1269
  • [30] Towards heterogeneous multi-scale computing on large scale parallel supercomputers
    Alowayyed S.
    Vassaux M.
    Czaja B.
    Coveney P.V.
    Hoekstra A.G.
    Supercomputing Frontiers and Innovations, 2019, 6 (04) : 20 - 43