CommentFinder: A Simpler, Faster, More Accurate Code Review Comments Recommendation

被引:29
作者
Hong, Yang [1 ]
Tantithamthavorn, Chakkrit [1 ]
Thongtanunam, Patanamon [2 ]
Aleti, Aldeida [1 ]
机构
[1] Monash Univ, Melbourne, Vic, Australia
[2] Univ Melbourne, Melbourne, Vic, Australia
来源
PROCEEDINGS OF THE 30TH ACM JOINT MEETING EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, ESEC/FSE 2022 | 2022年
关键词
Software Quality Assurance; Modern Code Review;
D O I
10.1145/3540250.3549119
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Code review is an effective quality assurance practice, but can be labor-intensive since developers have to manually review the code and provide written feedback. Recently, a Deep Learning (DL)-based approach was introduced to automatically recommend code review comments based on changed methods. While the approach showed promising results, it requires expensive computational resources and time which limits its use in practice. To address this limitation, we propose COMMENTFINDER s a retrieval-based approach to recommend code review comments. Through an empirical evaluation of 151,019 changed methods, we evaluate the effectiveness and efficiency of COMMENTFINDER against the state-of-the-art approach. We find that when recommending the best-1 review comment candidate, our COMMENTFINDER is 32% better than prior work in recommending the correct code review comment. In addition, COMMENTFINDER is 49 times faster than the prior work. These findings highlight that our COMMENTFINDER could help reviewers reduce manual efforts by recommending code review comments, while requiring less computational time.
引用
收藏
页码:507 / 519
页数:13
相关论文
共 68 条
[1]   Recovering traceability links between code and documentation [J].
Antoniol, G ;
Canfora, G ;
Casazza, G ;
De Lucia, A ;
Merlo, E .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2002, 28 (10) :970-983
[2]  
Bacchelli A, 2013, PROCEEDINGS OF THE 35TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2013), P712, DOI 10.1109/ICSE.2013.6606617
[3]  
Bakkelund Daniel, 2009, LCS BASED STRING MET
[4]  
Balachandran V, 2013, PROCEEDINGS OF THE 35TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2013), P931, DOI 10.1109/ICSE.2013.6606642
[5]  
Bavota G, 2015, PROC IEEE INT CONF S, P81, DOI 10.1109/ICSM.2015.7332454
[6]  
Beller M., 2014, P 11 WORK C MIN SOFT, P202
[7]   Characteristics of Useful Code Reviews: An Empirical Study at Microsoft [J].
Bosu, Amiangshu ;
Greiler, Michaela ;
Bird, Christian .
12TH WORKING CONFERENCE ON MINING SOFTWARE REPOSITORIES (MSR 2015), 2015, :146-156
[8]   Assessing the Students' Understanding and their Mistakes in Code Review Checklists -An Experience Report of 1,791 Code Review Checklist Questions from 394 Students- [J].
Chong, Chun Yong ;
Thongtanunam, Patanamon ;
Tantithamthavorn, Chakkrit .
2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: JOINT TRACK ON SOFTWARE ENGINEERING EDUCATION AND TRAINING (ICSE-JSEET 2021), 2021, :20-29
[9]  
Craw Susan, 2010, Manhattan Distance, P639, DOI [10.1007/978-0-387-30164-8506, DOI 10.1007/978-0-387-30164-8506]
[10]   Code Reviews Do Not Find Bugs How the Current Code Review Best Practice Slows Us Down [J].
Czerwonka, Jacek ;
Greiler, Michaela ;
Tilford, Jack .
2015 IEEE/ACM 37TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, VOL 2, 2015, :27-28