On the Evaluation of Large Language Models in Unit Test Generation

被引:0
|
作者
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词
Compendex;
D O I
暂无
中图分类号
学科分类号
摘要
Software design
引用
收藏
页码:1607 / 1619
相关论文
共 50 条
  • [31] Learning Mathematics with Large Language Models: A Comparative Study with Computer Algebra Systems and Other Tools
    Matzakos, Nikolaos
    Doukakis, Spyridon
    Moundridou, Maria
    International Journal of Emerging Technologies in Learning, 2023, 18 (20) : 51 - 71
  • [32] InteNSE: Interpretability, Robustness, and Benchmarking in Neural Software Engineering (Second Edition: Large Language Models)
    University of Illinois, Urbana-Champaign, United States
    不详
    不详
    不详
    Proc. - IEEE/ACM Int. Workshop Interpretability, Robust., Benchmarking Neural Softw. Eng. InteNSE, (VI):
  • [33] CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitions
    Rao, Jun
    Liu, Xuebo
    Lian, Lian
    Cheng, Shengjun
    Liao, Yunjie
    Zhang, Min
    EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, 2024, : 10064 - 10083
  • [34] Accelerating Sparse Autoencoder Training via Layer-Wise Transfer Learning in Large Language Models
    Ghilardi, Davide
    Belotti, Federico
    Molinari, Marco
    Lim, Jaehyuk
    BlackboxNLP 2024 - 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP - Proceedings of the Workshop, 2024, : 530 - 550
  • [35] Call for papers: Special issue on biomedical multimodal large language models- novel approaches and applications
    Bian, Jiang
    Peng, Yifan
    Mendonca, Eneida
    Banerjee, Imon
    Xu, Hua
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 157
  • [36] JAILBREAK ANTIDOTE: RUNTIME SAFETY-UTILITY BALANCE VIA SPARSE REPRESENTATION ADJUSTMENT IN LARGE LANGUAGE MODELS
    Shen, Guobin
    Zhao, Dongcheng
    Dong, Yiting
    He, Xiang
    Zeng, Yi
    arXiv,
  • [37] TEST PROCEDURES AND TEST SETS FOR LARGE EMD PABXs
    Bitzl, Walter
    Nottnagel, Wolf
    1600, (08):
  • [38] Repetition and Language Models and Comparable Corpora
    Church, Ken
    BUCC 2009 - 2nd Workshop on Building and Using Comparable Corpora: From Parallel to Non-Parallel Corpora at the ACL-IJCNLP 2009 - Proceedings, 2009,
  • [39] Language Models: Past, Present, and Future
    Li, Hang
    COMMUNICATIONS OF THE ACM, 2022, 65 (07) : 56 - 63
  • [40] Prediction of water saturation in tight sandstone reservoirs from well log data based on the large language models (LLMs)
    Wu, Juan
    Luo, Renze
    Lei, Canru
    Yin, Jiang
    Chen, Xingting
    Natural Gas Industry, 44 (09): : 77 - 87