ComplexCodeEval: A Benchmark for Evaluating Large Code Models on More Complex Code

被引：0
|
作者：
Feng, Jia [1 ]
Liu, Jiachen [2 ]
Gao, Cuiyun [2 ]
Chong, Chun Yong [3 ]
Wang, Chaozheng [4 ]
Gao, Shan [5 ]
Xia, Xin [5 ]
机构：
[1] University of Electronic Science and Technology of China, Shenzhen, China
[2] Harbin Institute of Technology, Shenzhen, China
[3] HUAWEI, Hong Kong, Hong Kong
[4] The Chinese University of Hong Kong, Hong Kong, Hong Kong
[5] Huawei, Shenzhen, China
来源：
Proceedings - 2024 39th ACM/IEEE International Conference on Automated Software Engineering, ASE 2024 |
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Information leakage
引用
收藏
页码：1895 / 1906
相关论文
共 22 条
  • [1] Evaluating Source Code Quality with Large Language Models: a comparative study
    da Silva Simões, Igor Regis
    Venson, Elaine
    arXiv,
  • [2] A Comprehensive Framework for Evaluating API-oriented Code Generation in Large Language Models
    Wu, Yixi
    He, Pengfei
    Wang, Zehao
    Wang, Shaowei
    Tian, Yuan
    Chen, Tse-Hsun
    arXiv,
  • [3] Comparative Analysis of Large Language Models in Source Code Analysis
    Erdoğan, Hüseyin
    Turan, Nezihe Turhan
    Onan, Aytuğ
    Lecture Notes in Networks and Systems, 2024, 1088 LNNS : 185 - 192
  • [4] Multilingual Code Co-evolution using Large Language Models
    Zhang, Jiyang
    Nie, Pengyu
    Li, Junyi Jessy
    Gligoric, Milos
    ESEC/FSE 2023 - Proceedings of the 31st ACM Joint Meeting European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2023, : 695 - 707
  • [5] Exploring the Impact of the Output Format on the Evaluation of Large Language Models for Code Translation
    Macedo, Marcos
    Tian, Yuan
    Cogo, Filipe R.
    Adams, Bram
    arXiv,
  • [6] CROSSCODEEVAL: A Diverse and Multilingual Benchmark for Cross-File Code Completion
    Ding, Yangruibo
    Wang, Zijian
    Ahmad, Wasi Uddin
    Ding, Hantian
    Tan, Ming
    Jain, Nihal
    Ramanathan, Murali Krishna
    Nallapati, Ramesh
    Bhatia, Parminder
    Roth, Dan
    Xiang, Bing
    arXiv, 2023,
  • [7] Evaluating documenting techniques on frameworks of object-oriented code
    Faculty of Information Technology, Multimedia University, 63100 Cyberjaya, Malaysia
    ICCAIE - IEEE Conf. Comput. Appl. Ind. Electron., (465-470):
  • [8] A C5 benchmark problem with the discrete ordinates radiation transport code denovo
    Oak Ridge National Laboratory, Oak Ridge, TN 37831, United States
    不详
    Nucl Technol, 2 (274-283):
  • [9] Reliability evaluating of evidential network nodes with hybrid-code genetic algorithm
    Chen, Zhi-Gang
    Li, Xian
    Jing, Pei-Liang
    Xu, Shi-You
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2015, 37 (07): : 1697 - 1702
  • [10] BENCHMARK CALCULATION FOR A SODIUM-COOLED FAST-REACTOR BY A 3-DIMENSIONAL VARIATIONAL CODE
    SRINIVASAN, L
    NUCLEAR SCIENCE AND ENGINEERING, 1981, 79 (02) : 228 - 233
123