<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Overview of Test Coverage Criteria for Test Case Generation from Finite State Machines Modelled as Directed Graphs
    Rechtberger, Vaclav
    Bures, Miroslav
    Ahmed, Bestoun S.
    2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW 2022), 2022, : 207 - 214
  • [32] A Test Case Generation Method for Workflow Systems Based on I/O_WF_Net
    LI, Shanling
    Zheng, Changyou
    Shi, Yaqing
    Zhang, Sainan
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2023, 30 (01): : 235 - 240
  • [33] Automated test case generation for the stress testing of multimedia systems
    Zhang, J
    Cheung, SC
    SOFTWARE-PRACTICE & EXPERIENCE, 2002, 32 (15) : 1411 - 1435
  • [34] Test Case Generation Based on Adaptive Genetic Algorithm
    Lin, Peng
    Bao, Xiaolu
    Shu, Zhiyong
    Wang, Xiaojuan
    Liu, Jingmin
    2012 INTERNATIONAL CONFERENCE ON QUALITY, RELIABILITY, RISK, MAINTENANCE, AND SAFETY ENGINEERING (ICQR2MSE), 2012, : 863 - 866
  • [35] EFSM Amorphous Slicing Based Test Case Generation
    Su N.
    Guo J.
    Li Z.
    Zhao R.
    Li, Zheng (lizheng@mail.buct.edu.cn), 1600, Science Press (54): : 669 - 680
  • [36] Test Case Optimization Based on State Transition Reduction
    Guo, Xi
    Wang, Jianyong
    MODERN TENDENCIES IN ENGINEERING SCIENCES, 2014, 533 : 432 - 435
  • [37] The Use of Ontology in Case Based Reasoning for Reusable Test Case Generation
    Li, Rui
    Ma, Shilong
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INDUSTRIAL ENGINEERING (AIIE 2015), 2015, 123 : 369 - 374
  • [38] Adversarial example-based test case generation for black-box speech recognition systems
    Cai, Hanbo
    Zhang, Pengcheng
    Dong, Hai
    Grunske, Lars
    Ji, Shunhui
    Yuan, Tianhao
    SOFTWARE TESTING VERIFICATION & RELIABILITY, 2023, 33 (05)
  • [39] Test Case Generation for Ethereum Smart Contract based on Data Dependency Analysis of State Variable
    Du, Jinhu
    Huang, Song
    Wang, Xingya
    Zheng, Changyou
    Sun, Jinlei
    2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY, QRS, 2022, : 710 - 720
  • [40] Crow Search Algorithm with Improved Objective Function for Test Case Generation and Optimization
    Sharma, Meena
    Pathik, Babita
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2022, 32 (02) : 1125 - 1140