Observational Behavioral Coding in the Pediatric Emergency Department: Development of the Emergency Department Child Behavior Coding System

Background: Despite improvements over the past decade, children continue to experience significant pain and distress surrounding invasive procedures in the emergency department (ED). To assess the impact of newly developed interventions, we must create more reliable and valid behavioral assessment tools that have been validated for the unique settings of pediatric EDs. Objective: This study aimed to create and test the Emergency Department Child Behavior Coding System (ED-CBCS) for the assessment of child distress and nondistress behaviors surrounding pediatric ED procedures. Methods: Via an iterative process, a multidisciplinary expert panel developed the ED-CBCS, an advanced time-based behavioral coding measure. Interrater reliability and concurrent validity were examined using 38 videos of children aged from 2 to 12 years undergoing laceration procedures. Face, Legs, Activity, Cry, Consolability (FLACC) scale scores were used to examine concurrent validity. Results: The final ED-CBCS included 27 child distress and nondistress behaviors. Time-unit kappa values from 0.64 to 0.98 and event alignment kappa values from 0.62 to 1.00 indicated good to excellent inter-rater reliability for all but one of the individual codes. ED-CBCS distress ( B = 1.26; p < 0.001) and nondistress behaviors ( B = -0.69, p = 0.025) were independently significantly associated with FLACC scores, indicating concurrent validity. Conclusions: We developed a psychometrically sound tool tailored for pediatric ED procedures. Future work could use this measure to better identify behavioral targets and test the effects of interventions to relieve pediatric ED pain and distress. (c) 2024 Elsevier Inc. All rights reserved.