Harnessing Generative AI to Enhance Feedback Quality in Peer Evaluations within Project-Based Learning Contexts

被引:0
作者
Sajadi, Susan [1 ]
Huerta, Mark [1 ]
Ryan, Olivia [1 ]
Drinkwater, Katie [1 ]
机构
[1] Virginia Tech, Dept Engn Educ, 375 Goodwin Hall, Blacksburg, VA 24060 USA
关键词
generative AI; LLMs; feedback; teamwork; problem or project-based learning (PBL); FORMATIVE ASSESSMENT; STUDENTS; INQUIRY; TEAMS;
D O I
暂无
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This paper explores using generative artificial intelligence (AI) large language models (LLMs) to augment traditional peer feedback processes within project-based learning (PBL) environments where students work in teams. Our study contributes to the expanding digital educational frontier by harnessing the power of LLMs for summarizing and enhancing self and peer feedback. We present a novel educational innovation that utilizes GPT-4 to effectively summarize self and peer comments for student teams in PBL courses. Our research involved the development of a specific prompt grounded in relevant educational theories and the analysis of 118 AI-summarized Performance Feedback Reports that were generated for students. The findings reveal that the LLM significantly improves the quality of peer feedback by making it more constructive and actionable, addresses off-topic or inappropriate comments, and provides a meaningful comparison between a student's self-evaluation and peer comments. Our paper underscores the importance of peer feedback systems as valuable pedagogical tools in PBL classes and demonstrates how AI tools can enhance these systems. The outcomes of this research serve as a foundational guide for faculty, especially those teaching in PBL environments with student teams, who are considering using AI to enhance teaching and learning. We demonstrate the potential of integrating these innovative practices in PBL classrooms to support students' development of teamwork skills, marking a significant step towards a new digital frontier in engineering education.
引用
收藏
页码:998 / 1012
页数:15
相关论文
共 44 条
[1]   Generative AI in Education and Research: Opportunities, Concerns, and Solutions [J].
Alasadi, Eman A. A. ;
Baiz, Carlos R. R. .
JOURNAL OF CHEMICAL EDUCATION, 2023, 100 (08) :2965-2971
[2]  
Baidoo-Anu D., 2023, SSRN Electronic Journal, P1
[3]   SOCIAL COGNITIVE THEORY OF SELF-REGULATION [J].
BANDURA, A .
ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1991, 50 (02) :248-287
[4]   ChatGPT in physics education: A pilot study on easy-to-implement activities [J].
Bitzenbauer, Philipp .
CONTEMPORARY EDUCATIONAL TECHNOLOGY, 2023, 15 (03)
[5]   Team Effectiveness Theory from Industrial and Organizational Psychology Applied to Engineering Student Project Teams: A Research Review [J].
Borrego, Maura ;
Karlin, Jennifer ;
McNair, Lisa D. ;
Beddoes, Kacey .
JOURNAL OF ENGINEERING EDUCATION, 2013, 102 (04) :472-512
[6]  
Braun V., 2006, Qualitative Research in Psychology, V3, P77, DOI [10.1191/1478088706qp063oa, DOI 10.1191/1478088706QP063OA]
[7]  
Brooks C.M., 2003, J EDUC BUS, V78, P268, DOI DOI 10.1080/08832320309598613
[8]   Can Business Students Learn to Evaluate Better? Evidence From Repeated Exposure to a Peer-Evaluation System [J].
Brutus, Stephane ;
Donia, Magda B. L. ;
Ronen, Sigalit .
ACADEMY OF MANAGEMENT LEARNING & EDUCATION, 2013, 12 (01) :18-31
[9]   Improving the Effectiveness of Students in Groups With a Centralized Peer Evaluation System [J].
Brutus, Stephane ;
Donia, Magda B. L. .
ACADEMY OF MANAGEMENT LEARNING & EDUCATION, 2010, 9 (04) :652-662
[10]   Peer review in team-based learning: influencing feedback literacy [J].
Burgess, Annette ;
Roberts, Chris ;
Lane, Andrew Stuart ;
Haq, Inam ;
Clark, Tyler ;
Kalman, Eszter ;
Pappalardo, Nicole ;
Bleasel, Jane .
BMC MEDICAL EDUCATION, 2021, 21 (01)