Development of Simulation-Based Assessment for Pediatric Intensive Care Nurse Orientation

Background: We developed a simulation-based assessment instrument for the pediatric intensive care unit (ICU) nurse orientation and aimed to establish reliability and validity. Method: Three pediatric ICU scenarios were developed. Interrater reliability between two raters was assessed by intraclass correlation coefficient (ICC). The scores were assessed to support validity between the nurse preceptor and orientee as well as the orientees' progression during the orientation period. Results: Forty-eight orientees and 11 ICU nurse preceptors participated in the simulations. The ICC for the overall score between two raters was high (ICC = 0.90, 95% CI: 0.88-0.91). The overall scores for the scenarios by preceptors were higher than the scores by orientees (81.2 +/- 19.6 vs. 58.8 +/- 13.0; p = .005; and 76.4 +/- 7.4 vs. 52.8 +/- 13; p<.001). The orientees' scores improved through the orientation (first simulation: 57.2 +/- 13.4, last: 78.1 +/- 12.4, p<.001). Conclusions: Simulation-based assessment for ICU pediatric nurse orientees demonstrated robust interrater reliability and validity. (C) 2021 International Nursing Association for Clinical Simulation and Learning. Published by Elsevier Inc. All rights reserved.