Generative AI vs. instructor vs. peer assessments: a comparison of grading and feedback in higher education

被引:2
作者
Usher, Maya [1 ,2 ]
机构
[1] Technion Israel Inst Technol, Fac Educ Sci & Technol, Haifa, Israel
[2] HIT Holon Inst Technol, Fac Instruct Technol, Holon, Israel
关键词
Generative Artificial Intelligence (GenAI); higher education; peer assessment; chatbot-based assessment; METAANALYSIS; IMPACT;
D O I
10.1080/02602938.2025.2487495
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The integration of Generative Artificial Intelligence (GenAI) in education has introduced innovative approaches to assessment. One such approach is AI chatbot-based assessment, which utilizes large language models to provide students with timely and consistent feedback. However, the effectiveness of AI chatbots in generating assessments comparable to human evaluators in educational contexts remains underexplored. This study compared the grades and feedback provided by AI chatbots, peers, and the course instructor for student projects in a higher education course. The participants were 76 undergraduate students who engaged in a group project involving three phases: questionnaire development, peer assessment, and chatbot-based assessment. Employing a mixed-methods approach, this study quantitatively compared project grades and qualitatively analyzed feedback quality. Results indicated that AI chatbots consistently assigned higher grades than human assessors, while peer and instructor grades were notably lower and closely aligned. Content analysis revealed that chatbots generally provided higher-quality feedback compared to peers, offering detailed insights and specific guidance for improvement, though they occasionally included irrelevant or contradictory information requiring student intervention. Conversely, peer feedback was more personalized and context-sensitive. These findings highlight the importance of human judgment, suggesting that integrating chatbot-based assessments with traditional methods can leverage their complementary strengths to enrich student learning.
引用
收藏
页数:16
相关论文
共 50 条
[41]   Face-to-face vs. online peer support groups for prostate cancer: A cross-sectional comparison study [J].
Huber, Johannes ;
Muck, Tanja ;
Maatz, Philipp ;
Keck, Bastian ;
Enders, Paul ;
Maatouk, Imad ;
Ihrig, Andreas .
JOURNAL OF CANCER SURVIVORSHIP, 2018, 12 (01) :1-9
[42]   Cryothermal vs. radiofrequency ablation as atrial flutter therapy: a randomized comparison [J].
Bastani, Hamid ;
Drca, Nikola ;
Insulander, Per ;
Schwieler, Jonas ;
Braunschweig, Frieder ;
Kenneback, Goran ;
Sadigh, Bita ;
Tapanainen, Jari ;
Jensen-Urstad, Mats .
EUROPACE, 2013, 15 (03) :420-428
[43]   Home-monitoring of oral anticoagulation vs. dabigatran An indirect comparison [J].
Alonso-Coello, Pablo ;
Zhou, Qi ;
Guyatt, Gordon .
THROMBOSIS AND HAEMOSTASIS, 2012, 108 (04) :647-653
[44]   The environmental comparison of landfilling vs. incineration of MSW accounting for waste diversion [J].
Assamoi, Bernadette ;
Lawryshyn, Yuri .
WASTE MANAGEMENT, 2012, 32 (05) :1019-1030
[45]   Effectiveness comparison of inpatient vs. outpatient pulmonary rehabilitation: a systematic review [J].
Molinier, Virginie ;
Alexandre, Francois ;
Heraud, Nelly .
BMC HEALTH SERVICES RESEARCH, 2022, 22 (01)
[46]   Continued professional development: A comparison of online vs. in-person workshops [J].
Gallegos, Patrick J. ;
Mistry, Bhavin ;
Freshwater, Dustin ;
Mullen, Chanda .
CURRENTS IN PHARMACY TEACHING AND LEARNING, 2021, 13 (07) :770-775
[47]   Coping with emotional pain: An experimental comparison of acceptance vs. avoidance coping [J].
Konstantinou, Pinelopi ;
Trigeorgi, Andria ;
Georgiou, Chryssis ;
Michaelides, Michalis ;
Gloster, Andrew T. ;
McHugh, Louise ;
Panayiotou, Georgia ;
Karekla, Maria .
JOURNAL OF CONTEXTUAL BEHAVIORAL SCIENCE, 2024, 33
[48]   Comparison of laboratory parameters in mild vs. severe cases and died vs. survived patients with COVID-19: systematic review and meta-analysis [J].
Cao, Budao ;
Jing, Xuefen ;
Liu, Yan ;
Wen, Rong ;
Wang, Cuifeng .
JOURNAL OF THORACIC DISEASE, 2022, 14 (05) :1478-1487
[49]   The Effects of Assumed AI vs. Human Authorship on the Perception of a GPT-Generated Text [J].
Henestrosa, Angelica Lermann ;
Kimmerle, Joachim .
JOURNALISM AND MEDIA, 2024, 5 (03) :1085-1097
[50]   Online vs. on-campus higher education: Exploring innovation in students' self-reports and students' learning products [J].
Usher, Maya ;
Barak, Miri ;
Haick, Hossam .
THINKING SKILLS AND CREATIVITY, 2021, 42