Development and Testing of an Instrument for Summative Assessment of Practical Skill Performance: A Generalizability Theory Approach

被引:2
作者
Bjork, Ida Torunn [1 ]
Larsen, Karin [2 ]
Ravik, Monika [3 ]
Reierson, Inger Ase [3 ]
Sommer, Irene [2 ]
Stenholt, Britta [4 ]
Brynildsen, Grethe [5 ]
Blomberg, Karin [6 ]
Bolenius, Karin [7 ]
Husebo, Sissel Eikeland [8 ,9 ]
Lamas, Kristina [7 ]
Hagtvet, Knut Arne [10 ]
机构
[1] Univ Oslo, Oslo, Norway
[2] Aarhus Univ Hosp, Aarhus N, Denmark
[3] Univ South Eastern Norway, Porsgrunn, Norway
[4] VIA Univ Coll, Nurse Educ, Aarhus N, Denmark
[5] Lovisenberg Diaconal Univ Coll, Oslo, Norway
[6] Orebro Univ, Orebro, Sweden
[7] Umea Univ, Umea, Sweden
[8] Univ Stavanger, Stavanger, Norway
[9] Stavanger Univ Hosp, Stavanger, Norway
[10] Univ Oslo, Dept Psychol, Oslo, Norway
关键词
practical skill performance; multifacet summative assessment; generalizability estimation; nursing education; NURSING-STUDENTS; NURSES; COMPETENCE; EDUCATION; MODEL; INTERVENTION; PERCEPTIONS; RELIABILITY; EXPERIENCES; VALIDATION;
D O I
10.1891/JNM-D-20-00003
中图分类号
R47 [护理学];
学科分类号
1011 ;
摘要
Background and Purpose: Many newly graduated nurses lack proficiency in practical skill performance. Presently, nursing students' practical skill is assessed by summative instruments with overarching items. The purpose of this study was to develop a more detailed instrument to use in summative assessment of nursing students' practical skill performance and to assess its psychometric properties. Methods: A 50-item instrument was developed. Video-recorded performances were rated by experienced clinical supervisors. A multifacet measurement design was developed. Relevant parameters were estimated by generalizability analysis. Results: Findings indicated that error of measurement were mainly caused by raters far more than by items. Conclusions: The present study suggested that summative assessment in realistic settings may not apply one rater only. Two to three/four raters appear necessary to dependably measure most skills.
引用
收藏
页码:E162 / E191
页数:30
相关论文
共 43 条
[21]  
Crick J. E., 1983, AM COLL TESTING TECH, V43
[22]  
CRONBACH L J, 1972, P410
[23]   THEORY OF GENERALIZABILITY - A LIBERALIZATION OF RELIABILITY THEORY [J].
CRONBACH, LJ ;
RAJARATNAM, N ;
GLESER, GC .
BRITISH JOURNAL OF STATISTICAL PSYCHOLOGY, 1963, 16 (02) :137-163
[24]   Tensions in learning professional identities - nursing students' narratives and participation in practical skills during their clinical practice: an ethnographic study [J].
Ewertsson, Mona ;
Bagga-Gupta, Sangeeta ;
Allvin, Renee ;
Blomberg, Karin .
BMC NURSING, 2017, 16
[25]   Use of technical skills and medical devices among new registered nurses: A questionnaire study [J].
Ewertsson, Mona ;
Gustafsson, Margareta ;
Blomberg, Karin ;
Holmstrom, Inger K. ;
Allvin, Renee .
NURSE EDUCATION TODAY, 2015, 35 (12) :1169-1174
[26]   Peripheral venous catheter care in the emergency department: Education and feedback lead to marked improvements [J].
Fakih, Mohamad G. ;
Jones, Karen ;
Rey, Janice E. ;
Takla, Robert ;
Szpunar, Susanna ;
Brown, Karrie ;
Boelstler, Arlene ;
Saravolatz, Louis .
AMERICAN JOURNAL OF INFECTION CONTROL, 2013, 41 (06) :531-536
[27]   The power of feedback [J].
Hattie, John ;
Timperley, Helen .
REVIEW OF EDUCATIONAL RESEARCH, 2007, 77 (01) :81-112
[28]   Reliability and Validity Testing of the Creighton Competency Evaluation Instrument for Use in the NCSBN National Simulation Study [J].
Hayden, Jennifer ;
Keegan, Mary ;
Kardong-Edgren, Suzan ;
Smiley, Richard A. .
NURSING EDUCATION PERSPECTIVES, 2014, 35 (04) :244-252
[29]  
Hayden JK, 2014, J NURS REGUL, V5, pS3
[30]   Summative assessment of clinical practice of student nurses: A review of the literature [J].
Helminen, Kristiina ;
Coco, Kirsi ;
Johnson, Martin ;
Turunen, Hannele ;
Tossavainen, Kerttu .
INTERNATIONAL JOURNAL OF NURSING STUDIES, 2016, 53 :308-319