On the Evaluation of Large Language Models in Unit Test Generation

被引：0
|
作者：
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构：
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Software design
引用
收藏
页码：1607 / 1619
相关论文
共 50 条
  • [1] A Comprehensive Framework for Evaluating API-oriented Code Generation in Large Language Models
    Wu, Yixi
    He, Pengfei
    Wang, Zehao
    Wang, Shaowei
    Tian, Yuan
    Chen, Tse-Hsun
    arXiv,
  • [2] Exploring the Impact of the Output Format on the Evaluation of Large Language Models for Code Translation
    Macedo, Marcos
    Tian, Yuan
    Cogo, Filipe R.
    Adams, Bram
    arXiv,
  • [3] Accelerating materials language processing with large language models
    Choi, Jaewoong
    Lee, Byungju
    COMMUNICATIONS MATERIALS, 2024, 5 (01)
  • [4] TRUSTLLM: TRUSTWORTHINESS IN LARGE LANGUAGE MODELS
    Huang, Yue
    Sun, Lichao
    Wang, Haoran
    Wu, Siyuan
    Zhang, Qihui
    Li, Yuan
    Gao, Chujie
    Huang, Yixin
    Lyu, Wenhan
    Zhang, Yixuan
    Li, Xiner
    Sun, Hanchi
    Liu, Zhengliang
    Liu, Yixin
    Wang, Yijue
    Zhang, Zhikun
    Vidgen, Bertie
    Kailkhura, Bhavya
    Xiong, Caiming
    Xiao, Chaowei
    Li, Chunyuan
    Xing, Eric
    Huang, Furong
    Liu, Hao
    Ji, Heng
    Wang, Hongyi
    Zhang, Huan
    Yao, Huaxiu
    Kellis, Manolis
    Zitnik, Marinka
    Jiang, Meng
    Bansal, Mohit
    Zou, James
    Pei, Jian
    Liu, Jian
    Gao, Jianfeng
    Han, Jiawei
    Zhao, Jieyu
    Tang, Jiliang
    Wang, Jindong
    Vanschoren, Joaquin
    Mitchell, John
    Shu, Kai
    Xu, Kaidi
    Chang, Kai-Wei
    He, Lifang
    Huang, Lifu
    Backes, Michael
    Gong, Neil Zhenqiang
    Yu, Philip S.
    arXiv,
  • [5] TEXTUAL AESTHETICS IN LARGE LANGUAGE MODELS
    Jiang, Lingjie
    Huang, Shaohan
    Wu, Xun
    Wei, Furu
    arXiv,
  • [6] Measuring Attribution in Natural Language Generation Models
    Rashkin, Hannah
    Nikolaev, Vitaly
    Lamm, Matthew
    Aroyo, Lora
    Collins, Michael
    Das, Dipanjan
    Petrov, Slav
    Tomar, Gaurav Singh
    Turc, Iulia
    Reitter, David
    COMPUTATIONAL LINGUISTICS, 2023, 49 (04) : 777 - 840
  • [7] Automated regression unit test generation for program merges
    Ji, Tao
    Chen, Liqian
    Mao, Xiaoguang
    Yi, Xin
    Jiang, Jiahong
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (09)
  • [8] Prepare for truly useful large language models
    不详
    NATURE BIOMEDICAL ENGINEERING, 2023, 7 (02) : 85 - 86
  • [9] Evaluation of Open-Source Large Language Models for Metal-Organic Frameworks Research
    Bai, Xuefeng
    Xie, Yabo
    Zhang, Xin
    Han, Honggui
    Li, Jian-Rong
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2024, 64 (13) : 4958 - 4965
  • [10] Conversational Complexity for Assessing Risk in Large Language Models
    Burden, John
    Cebrian, Manuel
    Hernandez-Orallo, Jose
    arXiv,
12345