The impact of a faculty development seminar on the quality of multiple-choice questions

被引:9
作者
Nemec, Eric C. [1 ]
Welch, Beth [1 ]
机构
[1] Western New England Univ, Coll Pharm, Dept Pharm Practice, 1215 Wilbraham Rd, Springfield, MA 01119 USA
关键词
Multiple-choice questions; Assessment; Faculty development;
D O I
10.1016/j.cptl.2015.12.008
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Introduction.' Multiple-choice questions (MCQ) are almost ubiquitous in higher education. The composition of quality MCQ is an art that takes practice and multiple revisions. Internal evaluations within other health profession disciplines indicate that the quality of faculty developed MCQ are relatively poor. Materials and methods: A 1.5 hour faculty development seminar was developed regarding the construction and the assessment of MCQ. Faculty submitted MCQ both pre-seminar and post-seminar and these were assessed against a quality checklist and scoring system. Faculty were surveyed pre-session and post-session electronically regarding their confidence in constructing MCQ. Results: The mean pre-session MCQ quality score was 16.2 (SD = 2.4), which after revision improved to 18.1 (SD = 1.5, p < 0.05). Results of the individual learner strengths and needs assessment indicated that confidence of faculty identifying good and bad questions in their own work improved. Conclusion.' Faculty development seminars can improve the quality of in-house MCQ and improve faculty confidence in constructing new MCQ. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:160 / 163
页数:4
相关论文
共 11 条
[1]   Faculty development programs improve the quality of Multiple Choice Questions items' writing [J].
Abdulghani, Hamza Mohammad ;
Ahmad, Farah ;
Irshad, Mohammad ;
Khalil, Mahmoud Salah ;
Al-Shaikh, Ghadeer Khalid ;
Syed, Sadiqa ;
Aldrees, Abdulmajeed Abdurrahman ;
Alrowais, Norah ;
Haque, Shafiul .
SCIENTIFIC REPORTS, 2015, 5
[2]   The effects of violating standard item writing principles on tests and students: The consequences of using flawed test items on achievement examinations in medical education [J].
Downing, SM .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2005, 10 (02) :133-143
[3]   Construct-irrelevant variance and flawed test questions: Do multiple-choice item-writing principles make any difference? [J].
Downing, SM .
ACADEMIC MEDICINE, 2002, 77 (10) :S103-S104
[4]   The quality of in-house medical school examinations [J].
Jozefowicz, RF ;
Koeppen, BM ;
Case, S ;
Galbraith, R ;
Swanson, D ;
Glew, RH .
ACADEMIC MEDICINE, 2002, 77 (02) :156-161
[5]   Identification of technical item flaws leads to improvement of the quality of single best Multiple Choice Questions [J].
Khan, Humaira Fayyaz ;
Danish, Khalid Farooq ;
Awan, Azra Saeed ;
Anwar, Masood .
PAKISTAN JOURNAL OF MEDICAL SCIENCES, 2013, 29 (03) :715-718
[6]   Faculty development on item writing substantially improves item quality [J].
Naeem, Naghma ;
van der Vleuten, Cees ;
Alfaris, Eiad Abdelmohsen .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2012, 17 (03) :369-376
[7]   Assessment of Item-Writing Flaws in Multiple-Choice Questions [J].
Nedeau-Cayo, Rosemarie ;
Laughlin, Deborah ;
Rus, Linda ;
Hall, John .
JOURNAL FOR NURSES IN PROFESSIONAL DEVELOPMENT, 2013, 29 (02) :52-57
[8]   Teaching residents how to teach: A Scholarship of Teaching and Learning Certificate Program (STLC) for pharmacy residents [J].
Romanelli, F ;
Smith, KM ;
Brandt, BF .
AMERICAN JOURNAL OF PHARMACEUTICAL EDUCATION, 2005, 69 (02) :126-132
[9]   Impact of item-writing flaws in multiple-choice questions on student achievement in high-stakes nursing assessments [J].
Tarrant, Marie ;
Ware, James .
MEDICAL EDUCATION, 2008, 42 (02) :198-206
[10]   The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments [J].
Tarrant, Marie ;
Knierim, Aimee ;
Hayes, Sasha K. ;
Ware, James .
NURSE EDUCATION TODAY, 2006, 26 (08) :662-671