QuCAT: A Combinatorial Testing Tool for Quantum Software

被引:4
作者
Wang, Xinyi [1 ]
Arcaini, Paolo [2 ]
Yue, Tao [1 ]
Ali, Shaukat [1 ,3 ]
机构
[1] Simula Res Lab, Oslo, Norway
[2] Natl Inst Informat, Tokyo, Japan
[3] Oslo Metropolitan Univ, Oslo, Norway
来源
2023 38TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, ASE | 2023年
关键词
quantum programs; software testing; combinatorial testing;
D O I
10.1109/ASE56229.2023.00062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increased developments in quantum computing, the availability of systematic and automatic testing approaches for quantum programs is becoming increasingly essential. To this end, we present the quantum software testing tool QuCAT for combinatorial testing of quantum programs. QuCAT provides two functionalities of use. With the first functionality, the tool generates a test suite of a given strength (e.g., pair-wise). With the second functionality, it generates test suites with increasing strength until a failure is triggered or a maximum strength is reached. QuCAT uses two test oracles to check the correctness of test outputs. We assess the cost and effectiveness of QuCAT with 3 faulty versions of 5 quantum programs. Results show that combinatorial test suites with a low strength can find faults with limited cost, while a higher strength performs better to trigger some difficult faults with relatively higher cost. Repository: https://github.com/Simula- COMPLEX/qucat- tool Video: https://youtu.be/UsqgOudKLio
引用
收藏
页码:2066 / 2069
页数:4
相关论文
共 22 条
  • [1] Metamorphic Testing of Oracle Quantum Programs
    Abreu, Rui
    Fernandes, Joao Paulo
    Liana, Luis
    Tavares, Guilherme
    [J]. 3RD INTERNATIONAL WORKSHOP ON QUANTUM SOFTWARE ENGINEERING (Q-SE 2022), 2022, : 16 - 23
  • [2] Agresti A., 2019, An Introduction to Categorical Data Analysis, Vthird
  • [3] Assessing the Effectiveness of Input and Output Coverage Criteria for Testing Quantum Programs
    Ali, Shaukat
    Arcaini, Paolo
    Wang, Xinyi
    Yue, Tao
    [J]. 2021 14TH IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2021), 2021, : 13 - 23
  • [4] Fortunato D., 2022, IEEE Transactions on Quantum Engineering, V3, P1
  • [5] QMutPy: A Mutation Testing Tool for Quantum Algorithms and Applications in Qiskit
    Fortunato, Daniel
    Campos, Jose
    Abreu, Rui
    [J]. PROCEEDINGS OF THE 31ST ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, ISSTA 2022, 2022, : 797 - 800
  • [6] Honarvar S., 2020, P IEEE ACM 42 INT C, P430, DOI DOI 10.1145/3387940.3391459
  • [7] Ma L, 2019, 2019 IEEE 26TH INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER), P614, DOI [10.1109/SANER.2019.8668044, 10.1109/saner.2019.8668044]
  • [8] Muskit: A Mutation Analysis Tool for Quantum Software Testing
    Mendiluze, Enaut
    Ali, Shaukat
    Arcaini, Paolo
    Yue, Tao
    [J]. 2021 36TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING ASE 2021, 2021, : 1266 - 1270
  • [9] Is Your Quantum Program Bug -Free?
    Miranskyy, Andriy
    Zhang, Lei
    Doliskani, Javad
    [J]. 2020 IEEE/ACM 42ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: NEW IDEAS AND EMERGING RESULTS (ICSE-NIER 2020), 2020, : 29 - 32
  • [10] On Testing Quantum Programs
    Miranskyy, Andriy
    Zhang, Lei
    [J]. 2019 IEEE/ACM 41ST INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: NEW IDEAS AND EMERGING RESULTS (ICSE-NIER 2019), 2019, : 57 - 60