<bold>IST A</bold> +: Test case generation and optimization for intelligent systems based on coverage analysis

被引:0
|
作者
Wu, Xiaoxue [1 ,4 ]
Gu, Yizeng [2 ]
Lin, Lidan [2 ]
Zheng, Wei [2 ]
Chen, Xiang [3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian, Peoples R China
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Key Lab Safety Crit Software, Minist Ind & Informat Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning testing; Coverage criteria; Test case generation; Test case optimization;
D O I
10.1016/j.scico.2024.103078
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the increasing use of intelligent systems in various domains such as self -driving cars, robotics, and smart cities, it is crucial to ensure the quality of intelligent systems for their reliable and effective use in various domains. However, testing intelligent systems poses unique challenges due to their complex structure, low efficiency, and the high cost associated with manually collecting a large number of test cases. Hence, it is crucial to design tools that can adequately test intelligent systems while overcoming these obstacles. We propose an intelligent system test tool called ISTA+. This tool implements automatic generation and optimization of test cases based on coverage analysis, resulting in improved test adequacy for intelligent systems. To evaluate the effectiveness of ISTA+, we applied it to two different models (fully -connected DNN and the Rambo model) and two datasets of different data types (i.e., image and text). The evaluation results demonstrate that ISTA+ successfully improves the test dataset quality and ensures comprehensive testing for both text and image data types. center dot Link to source code: https://github .com /wuxiaoxue /ISTAplus center dot Link to video demonstration: https://youtu .be /6CkzMJ0ghq8
引用
收藏
页数:11
相关论文
共 50 条
  • [21] An Orchestrated Survey on T-Way Test Case Generation Strategies Based on Optimization Algorithms
    Al-Sewari, AbdulRahman A.
    Zamli, Kamal Z.
    8TH INTERNATIONAL CONFERENCE ON ROBOTIC, VISION, SIGNAL PROCESSING & POWER APPLICATIONS: INNOVATION EXCELLENCE TOWARDS HUMANISTIC TECHNOLOGY, 2014, 291 : 255 - 263
  • [22] Search Based Techniques and Mutation Analysis in Automatic Test Case Generation: A Survey
    Dave, Meenu
    Agrawal, Rashmi
    2015 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2015, : 795 - 799
  • [23] Semantic-Based Test Case Generation
    Dadkhah, Mahboubeh
    2016 9TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST), 2016, : 377 - 378
  • [24] Genetic-based Crow Search Algorithm for Test Case Generation
    Tamizharasi, A.
    Ezhumalai, P.
    INTERNATIONAL TRANSACTION JOURNAL OF ENGINEERING MANAGEMENT & APPLIED SCIENCES & TECHNOLOGIES, 2022, 13 (04):
  • [25] A Proposed Methodology to Improve UVM-Based Test Generation and Coverage Closure
    Fathy, Khaled
    Salah, Khaled
    Guindi, Rafik
    2015 10TH INTERNATIONAL DESIGN & TEST SYMPOSIUM (IDT), 2015, : 147 - 148
  • [26] Overview of Test Coverage Criteria for Test Case Generation from Finite State Machines Modelled as Directed Graphs
    Rechtberger, Vaclav
    Bures, Miroslav
    Ahmed, Bestoun S.
    2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW 2022), 2022, : 207 - 214
  • [27] PC-TRT: A Test Case Reuse and generation Tool to achieve high path coverage for Unit Test
    Guo, Zhonghao
    Chen, Sinong
    Xu, Xinyue
    Chen, Xiangxian
    SOFTWAREX, 2024, 28
  • [28] A Model-based Test Case Generation Method for Function Testing of Train Control Systems
    Lv, Jidong
    Wang, Haifeng
    Liu, Hongjie
    Zhang, Lu
    Tang, Tao
    2016 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT RAIL TRANSPORTATION (ICIRT), 2016, : 334 - 346
  • [29] A Test Case Generation Method for Workflow Systems Based on I/O_WF_Net
    LI, Shanling
    Zheng, Changyou
    Shi, Yaqing
    Zhang, Sainan
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2023, 30 (01): : 235 - 240
  • [30] Automated test case generation for the stress testing of multimedia systems
    Zhang, J
    Cheung, SC
    SOFTWARE-PRACTICE & EXPERIENCE, 2002, 32 (15): : 1411 - 1435