On the Evaluation of Large Language Models in Unit Test Generation

被引:0
|
作者
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词
Compendex;
D O I
暂无
中图分类号
学科分类号
摘要
Software design
引用
收藏
页码:1607 / 1619
相关论文
共 50 条
  • [11] Enhancing Genetic Improvement Mutations Using Large Language Models
    Brownlee, Alexander E.I.
    Callan, James
    Even-Mendoza, Karine
    Geiger, Alina
    Hanna, Carol
    Petke, Justyna
    Sarro, Federica
    Sobania, Dominik
    arXiv, 2023,
  • [12] Comparative Analysis of Large Language Models in Source Code Analysis
    Erdoğan, Hüseyin
    Turan, Nezihe Turhan
    Onan, Aytuğ
    Lecture Notes in Networks and Systems, 2024, 1088 LNNS : 185 - 192
  • [13] Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Processing
    Huawei Technologies Co., Ltd.
    不详
    不详
    Proc. Conf. Empir. Methods Nat. Lang. Process., EMNLP, (3135-3151):
  • [14] Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding
    Ghaddar, Abbas
    Wu, Yimeng
    Bagga, Sunyam
    Rashid, Ahmad
    Bibi, Khalil
    Rezagholizadeh, Mehdi
    Xing, Chao
    Wang, Yasheng
    Xinyu, Duan
    Wang, Zhefeng
    Huai, Baoxing
    Jiang, Xin
    Liu, Qun
    Langlais, Philippe
    arXiv, 2022,
  • [15] From Large Language Models to Databases and Back: A Discussion on Research and Education
    Amer-Yahia, Sihem
    Bonifati, Angela
    Chen, Lei
    Li, Guoliang
    Shim, Kyuseok
    Xu, Jianliang
    Yang, Xiaochun
    SIGMOD RECORD, 2023, 52 (03) : 49 - 56
  • [16] Evaluating Source Code Quality with Large Language Models: a comparative study
    da Silva Simões, Igor Regis
    Venson, Elaine
    arXiv,
  • [17] Are Large Language Models Consistent over Value-laden Questions?
    Moore, Jared
    Deshpande, Tanvi
    Yang, Diyi
    arXiv,
  • [18] Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking
    Xu, Nan
    Wang, Fei
    Zhou, Ben
    Li, Bangzheng
    Xiao, Chaowei
    Chen, Muhao
    Findings of the Association for Computational Linguistics: NAACL 2024 - Findings, 2024, : 3526 - 3548
  • [19] Risk and Response in Large Language Models: Evaluating Key Threat Categories
    Harandizadeh, Bahareh
    Salinas, Abel
    Morstatter, Fred
    arXiv,
  • [20] Multilingual Code Co-evolution using Large Language Models
    Zhang, Jiyang
    Nie, Pengyu
    Li, Junyi Jessy
    Gligoric, Milos
    ESEC/FSE 2023 - Proceedings of the 31st ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2023, : 695 - 707