Formative and Summative Automated Assessment with Multiple-Choice Question Banks

被引:8
作者
Beerepoot, Maarten T. P. [1 ]
机构
[1] UiT Arctic Univ Norway, Dept Chem, N-9037 Tromso, Norway
关键词
First-Year Undergraduate; General Chemistry; Testing; Assessment; Item Banks; E-Learning; Online Quizzes; Web-Based Learning; ChatGPT; PERFORMANCE; CLASSROOM; DESIGN; TESTS; POWER; EXAMS;
D O I
10.1021/acs.jchemed.3c00120
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Digital automated assessment is a valuable and time-efficienttoolfor educators to provide immediate and objective feedback to learners.Automated assessment, however, puts high demands on the quality ofthe questions, alignment with the intended learning outcomes, andthe quality of the feedback provided to the learners. We here describethe development and use of a large number (N >180)of question banks with multiple items (N & GE;20) that are aligned to the intended learning outcomes of an undergraduategeneral chemistry course. Even though the development of a large numberof high-quality question banks is a formidable task, they allow forflexible and easy-to-implement solutions for formative and summativeassessment once developed. We here discuss three applications of thequestion banks: formative assessment in large online classes, practicetests that provide formative assessment outside classes, and summativeassessment through a digital exam. We highlight the importance ofaligning the question banks with intended learning outcomes, providingadditional feedback to the learners and of quality assurance of thequestion banks, and show how the combined use of the question bankssupports student self-regulated learning. We hope that the presentwork can inspire others to discover the various applications of questionbanks for formative and summative assessment.
引用
收藏
页码:2947 / 2955
页数:9
相关论文
共 42 条
[1]   Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research [J].
Abeysekera, Lakmal ;
Dawson, Phillip .
HIGHER EDUCATION RESEARCH & DEVELOPMENT, 2015, 34 (01) :1-14
[2]   LEWIS STRUCTURE SKILLS - TAXONOMY AND DIFFICULTY LEVELS [J].
BRADY, JA ;
MILBURYSTEEN, JN ;
BURMEISTER, JL .
JOURNAL OF CHEMICAL EDUCATION, 1990, 67 (06) :491-493
[3]  
Burton R.F., 2005, ASSESS EVAL HIGH EDU, V30, P65, DOI [10.1080/0260293042003243904, DOI 10.1080/0260293042003243904]
[4]   Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing [J].
Butler, Andrew C. ;
Roediger, Henry L., III .
MEMORY & COGNITION, 2008, 36 (03) :604-616
[5]   Multiple-Choice Exams and Guessing: Results from a One-Year Study of General Chemistry Tests Designed To Discourage Guessing [J].
Campbell, Mark L. .
JOURNAL OF CHEMICAL EDUCATION, 2015, 92 (07) :1194-1200
[6]   Bringing Nuance to Automated Exam and Classroom Response System Grading: A Tool for Rapid, Flexible, and Scalable Partial-Credit Scoring [J].
Carberry, Tom P. ;
Lukeman, Philip S. ;
Covell, Dustin J. .
JOURNAL OF CHEMICAL EDUCATION, 2019, 96 (08) :1767-1772
[7]   Investigating the Use of an Artificial Intelligence Chatbot with General Chemistry Exam Questions [J].
Clark, Ted M. .
JOURNAL OF CHEMICAL EDUCATION, 2023, 100 (05) :1905-1916
[8]   Evaluating and Improving Questions on an Unproctored Online General Chemistry Exam [J].
Clark, Ted M. ;
Turner, Daniel A. ;
Rostam, Darian C. .
JOURNAL OF CHEMICAL EDUCATION, 2022, :3510-3521
[9]   Testing in the Time of COVID-19: A Sudden Transition to Unproctored Online Exams [J].
Clark, Ted M. ;
Callam, Christopher S. ;
Paul, Noel M. ;
Stoltzfus, Matthew W. ;
Turner, Daniel .
JOURNAL OF CHEMICAL EDUCATION, 2020, 97 (09) :3413-3417
[10]   The future of online testing and assessment: question quality in MOOCs [J].
Costello, Eamon ;
Holland, Jane ;
Kirwan, Colette .
INTERNATIONAL JOURNAL OF EDUCATIONAL TECHNOLOGY IN HIGHER EDUCATION, 2018, 15