Event Analysis for Automated Estimation of Absent and Persistent Medication Alerts: Novel Methodology

Background: Event analysis is a promising approach to estimate the acceptance of medication alerts issued by computerized physician order entry (CPOE) systems with an integrated clinical decision support system (CDSS), particularly when alerts cannot be interactively confirmed in the CPOE-CDSS due to its system architecture. Medication documentation is then reviewed for documented evidence of alert acceptance, which can be a time-consuming process, especially when performed manually. Objective: We present a new automated event analysis approach, which was applied to a large data set generated in a CPOE-CDSS with passive, noninterruptive alerts. Methods: Medication and alert data generated over 3.5 months within the CPOE-CDSS at Heidelberg University Hospital were divided into 24 -hour time intervals in which the alert display was correlated with associated prescription changes. Alerts were considered "persistent" if they were displayed in every consecutive 24 -hour time interval due to a respective active prescription until patient discharge and were considered "absent" if they were no longer displayed during continuous prescriptions in the subsequent interval. Results: Overall, 1670 patient cases with 11,428 alerts were analyzed. Alerts were displayed for a median of 3 (IQR 1-7) consecutive 24 -hour time intervals, with the shortest alerts displayed for drug -allergy interactions and the longest alerts displayed for potentially inappropriate medication for the elderly (PIM). Among the total 11,428 alerts, 56.1% (n=6413) became absent, most commonly among alerts for drug -drug interactions (1915/2366, 80.9%) and least commonly among PIM alerts (199/499, 39.9%). Conclusions: This new approach to estimate alert acceptance based on event analysis can be flexibly adapted to the automated evaluation of passive, noninterruptive alerts. This enables large data sets of longitudinal patient cases to be processed, allows for the derivation of the ratios of persistent and absent alerts, and facilitates the comparison and prospective monitoring of these alerts. JMIR Med Inform 2024;12:e54428; doi: 10.2196/54428