A Survey of Testing Techniques Based on Large Language Models

被引:0
|
作者
Qi, Fei [1 ]
Hou, Yingnan [1 ]
Lin, Ning [1 ]
Bao, Shanshan [1 ]
Xu, Nuo [1 ]
机构
[1] Harbin Space Star Data Syst Technol Co Ltd, Harbin 150028, Peoples R China
来源
PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024 | 2024年
关键词
LLM; Software Testing Techniques; Pre-trained Large Language Model;
D O I
10.1145/3675249.3675298
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of software testing technology, Large Language Model (LLM) driven testing method have gradually become an emerging trend in the field of software testing. This paper presents a comprehensive review of LLM-based testing techniques. The results of 19 studies using LLM to optimize testing techniques are analyzed from the perspective of software testing. This paper discusses in detail how to use LLM to optimize test techniques for generating automated test code and generating diverse input in software test tasks. It also summarizes the challenges and opportunities faced by this field. The above conclusions can identify the shortcomings of LLM-based software testing technology and the direction of future research.
引用
收藏
页码:280 / 284
页数:5
相关论文
共 50 条
  • [1] Software Testing With Large Language Models: Survey, Landscape, and Vision
    Wang, Junjie
    Huang, Yuchao
    Chen, Chunyang
    Liu, Zhe
    Wang, Song
    Wang, Qing
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2024, 50 (04) : 911 - 936
  • [2] Privacy issues in Large Language Models: A survey
    Kibriya, Hareem
    Khan, Wazir Zada
    Siddiqa, Ayesha
    Khan, Muhammad Khurrum
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 120
  • [3] Best practices for implementing ChatGPT, large language models, and artificial intelligence in qualitative and survey-based research
    Kantor, Jonathan
    JAAD INTERNATIONAL, 2024, 14 : 22 - 23
  • [4] Large Language Models in Cyberattacks
    S. V. Lebed
    D. E. Namiot
    E. V. Zubareva
    P. V. Khenkin
    A. A. Vorobeva
    D. A. Svichkar
    Doklady Mathematics, 2024, 110 (Suppl 2) : S510 - S520
  • [5] SearchGEM5: Towards Reliable Gem5 with Search Based Software Testing and Large Language Models
    Dakhama, Aidan
    Even-Mendoza, Karine
    Langdon, W. B.
    Menendez, Hector
    Petke, Justyna
    SEARCH-BASED SOFTWARE ENGINEERING, SSBSE 2023, 2024, 14415 : 160 - 166
  • [6] Utilizing Fine-Tuning of Large Language Models for Generating Synthetic Payloads: Enhancing Web Application Cybersecurity through Innovative Penetration Testing Techniques
    Cirkovic, Stefan
    Mladenovic, Vladimir
    Tomic, Sinisa
    Drljaca, Dalibor
    Ristic, Olga
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 4409 - 4430
  • [7] Leveraging Large Language Models for Enhancing Literature-Based Discovery
    Taleb, Ikbal
    Navaz, Alramzana Nujum
    Serhani, Mohamed Adel
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (11)
  • [8] (Security) Assertions by Large Language Models
    Kande, Rahul
    Pearce, Hammond
    Tan, Benjamin
    Dolan-Gavitt, Brendan
    Thakur, Shailja
    Karri, Ramesh
    Rajendran, Jeyavijayan
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 4374 - 4389
  • [9] (A Comparative Study on Development Models of AI Chinese Language Partners Based on the ERNIE Large Language Model)
    Lian, Weichen
    Zheng, Mingjian
    Xu, Juan
    JOURNAL OF TECHNOLOGY AND CHINESE LANGUAGE TEACHING, 2024, 15 (02): : 35 - 53
  • [10] A Survey of Lay People's Willingness to Generate Legal Advice using Large Language Models (LLMs)
    Seabrooke, Tina
    Schneiders, Eike
    Dowthwaite, Liz
    Krook, Joshua
    Leesakul, Natalie
    Cios, Jeremie
    Maior, Horia
    Fischer, Joel
    PROCEEDINGS OF THE SECOND INTERNATIONAL SYMPOSIUM ON TRUSTWORTHY AUTONOMOUS SYSTEMS, TAS 2024, 2024,