EvaluMate: Using AI to support students' feedback provision in peer assessment for writing

被引:6
作者
Guo, Kai [1 ]
机构
[1] Univ Hong Kong, Fac Educ, Room 668,Meng Wah Complex,Pokfulam Rd, Hong Kong, Peoples R China
关键词
Peer feedback; Peer assessment; Large language models; Artificial intelligence; Writing;
D O I
10.1016/j.asw.2024.100864
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Peer feedback plays an important role in promoting learning in the writing classroom. However, providing high-quality feedback can be demanding for student reviewers. To address this challenge, this article proposes an AI-enhanced approach to peer feedback provision. I introduce EvaluMate, a newly developed online peer review system that leverages ChatGPT, a large language model (LLM), to scaffold student reviewers' feedback generation. I discuss the design and functionality of EvaluMate, highlighting its affordances in supporting student reviewers' provision of comments on peers' essays. I also address the system's limitations and propose potential solutions. Furthermore, I recommend future research on students' engagement with this learning approach and its impact on learning outcomes. By presenting EvaluMate, I aim to inspire researchers and practitioners to explore the potential of AI technology in the teaching, learning, and assessment of writing.
引用
收藏
页数:8
相关论文
共 24 条
[1]   Feedback sources in essay writing: peer-generated or AI-generated feedback? [J].
Banihashem, Seyyed Kazem ;
Kerman, Nafiseh Taghizadeh ;
Noroozi, Omid ;
Moon, Jewoong ;
Drachsler, Hendrik .
INTERNATIONAL JOURNAL OF EDUCATIONAL TECHNOLOGY IN HIGHER EDUCATION, 2024, 21 (01)
[2]   Teacher modeling on EFL reviewers' audience-aware feedback and affectivity in L2 peer review [J].
Chang, Carrie Yea-huey .
ASSESSING WRITING, 2015, 25 :2-21
[3]   From design to reflection: Effects of peer-scoring and comments on students' behavioral patterns and learning outcomes in musical theater performance [J].
Chen, I-Ching ;
Hwang, Gwo-Jen ;
Lai, Chiu-Lin ;
Wang, Wei-Chun .
COMPUTERS & EDUCATION, 2020, 150
[4]   Learning by Reviewing [J].
Cho, Kwangsu ;
MacArthur, Charles .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2011, 103 (01) :73-84
[5]   Students' perceptions of peer review for assessing digital multimodal composing: the case of a discipline-specific English course [J].
Deng, Yi ;
Liu, Dan ;
Feng, Dezheng .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2023, 48 (08) :1254-1267
[6]   Improving Peer Assessment Validity and Reliability Through a Fuzzy Coherence Measure [J].
El Alaoui, Mohamed .
IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2023, 16 (06) :892-899
[7]   A collaborative learning approach to dialogic peer feedback: a theoretical framework [J].
Er, Erkan ;
Dimitriadis, Yannis ;
Gasevic, Dragan .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2021, 46 (04) :586-600
[8]   Unpacking the contribution of linguistic features to graph writing quality: An analytic scoring approach [J].
Golparvar, Seyyed Ehsan ;
Abolhasani, Hamideh .
ASSESSING WRITING, 2022, 53
[9]   Exploring a Collaborative Approach to Peer Feedback in EFL Writing: How Do Students Participate? [J].
Guo, Kai ;
Chen, Xinyu ;
Qiao, Shen .
RELC JOURNAL, 2024, 55 (03) :658-672
[10]   The development of student feedback literacy: the influences of teacher feedback on peer feedback [J].
Han, Ye ;
Xu, Yueting .
ASSESSMENT & EVALUATION IN HIGHER EDUCATION, 2020, 45 (05) :680-696