On the Evaluation of Large Language Models in Unit Test Generation

被引:0
|
作者
Yang, Lin [1 ]
Yang, Chen [1 ]
Gao, Shutao [2 ]
Wang, Weijing [1 ]
Wang, Bo [3 ]
Zhu, Qihao [4 ]
Chu, Xiao [5 ]
Zhou, Jianyi [5 ]
Liang, Guangtai [5 ]
Wang, Qianxiang [5 ]
Chen, Junjie [1 ]
机构
[1] College of Intelligence and Computing, Tianjin University, China
[2] School of Future Technology, Tianjin University, China
[3] School of Computer and Information Technology, Beijing Jiaotong University, China
[4] Key Laboratory of HCST, MoE DCST, Peking University, China
[5] Huawei Cloud Computing Co. Ltd., China
来源
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词
Compendex;
D O I
暂无
中图分类号
学科分类号
摘要
Software design
引用
收藏
页码:1607 / 1619
相关论文
共 50 条
  • [21] A Determination Method of Robot Motion from Language Instruction with Error Correction of Motion Generation by Large Language Model
    Suzuki, Takahiro
    Hashimoto, Manabu
    Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, 2024, 90 (11): : 859 - 866
  • [22] Shaping the Safety Boundaries: Understanding and Defending Against Jailbreaks in Large Language Models
    Gao, Lang
    Zhang, Xiangliang
    Nakov, Preslav
    Chen, Xiuying
    arXiv,
  • [23] Application of Holistic Artificial Intelligence and Large Language Models for Comprehensive Information Collection
    Han, Xu
    Sun, Yawei
    Zhao, Lu
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (04): : 11 - 19
  • [24] Automated multiple-choice question generation in Spanish using neural language models
    de-Fitero-Dominguez, David
    Garcia-Cabot, Antonio
    Garcia-Lopez, Eva
    Neural Computing and Applications, 2024, 36 (29) : 18223 - 18235
  • [25] Using Large Language Models for Cybersecurity Capture-The-Flag Challenges and Certification Questions
    Tann, Wesley
    Liu, Yuancheng
    Sim, Jun Heng
    Seah, Choon Meng
    Chang, Ee-Chien
    arXiv, 2023,
  • [26] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models
    Zong, Yongshuo
    Bohdal, Ondrej
    Yu, Tingyang
    Yang, Yongxin
    Hospedales, Timothy
    Proceedings of Machine Learning Research, 2024, 235 : 62867 - 62891
  • [27] Automatically Correcting Large Language Models: Surveying the Landscape of Diverse Automated Correction Strategies
    Pan, Liangming
    Saxon, Michael
    Xu, Wenda
    Nathani, Deepak
    Wang, Xinyi
    Wang, William Yang
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2024, 12 : 484 - 506
  • [28] Privacy preserving large language models: ChatGPT case study based vision and framework
    Ullah, Imdad
    Hassan, Najm
    Gill, Sukhpal Singh
    Suleiman, Basem
    Ahanger, Tariq Ahamed
    Shah, Zawar
    Qadir, Junaid
    Kanhere, Salil S.
    IET Blockchain, 2024, 4 (S1): : 706 - 724
  • [29] Exploration of Generative Intelligent Application Mode for New Power Systems Based on Large Language Models
    Ding, Lifu
    Chen, Ying
    Xiao, Tannan
    Huang, Shaowei
    Shen, Chen
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2024, 48 (19): : 1 - 13
  • [30] Future-proofing geotechnics workflows: accelerating problem-solving with large language models
    Wu, Stephen
    Otake, Yu
    Mizutani, Daijiro
    Liu, Chang
    Asano, Kotaro
    Sato, Nana
    Baba, Hidetoshi
    Fukunaga, Yusuke
    Higo, Yosuke
    Kamura, Akiyoshi
    Kodama, Shinnosuke
    Metoki, Masataka
    Nakamura, Tomoka
    Nakazato, Yuto
    Saito, Taiga
    Shioi, Akihiro
    Takenobu, Masahiro
    Tsukioka, Keigo
    Yoshikawa, Ryo
    arXiv, 2023,