Artificial Intelligence-Guided Bronchoscopy is Superior to Human Expert Instruction for the Performance of Critical-Care Physicians: A Randomized Controlled Trial

OBJECTIVES:Bronchoscopy in the mechanically ventilated patient is an important skill for critical-care physicians. However, training opportunity is heterogenous and limited by infrequent caseload or inadequate instructor feedback for satisfactory competencies. A new artificial intelligence (AI) navigational system using augmented reality - the Ambu Broncho Simulator - can guide bronchoscopy training. Is training with the AI system comparable to bedside, expert tutor instruction in improving bronchoscopy performance?DESIGN:A nonblinded, parallel group randomized controlled trial was conducted.SETTING:The study was conducted in a simulated setting at an academic university hospital.SUBJECTS:Critical-care physicians were invited to take part in the study.INTERVENTIONS:Forty participants received 30 minutes of bronchoscopy training, either guided by AI only (artificial intelligence group [AIG]) or by expert tutor feedback (expert tutor group [ETG]). All participants performed a final full navigation bronchoscopy performance test and completed a cognitive load questionnaire, the NASA Task Load Index .MEASUREMENTS AND MAIN RESULTS:Mean intersegmental time (MIT = PT/DC), diagnostic completeness (DC), procedure time (PT), structured progress (SP), and number of segments revisited (SR) were measured. The primary outcome measure assessed was MIT, a measure of bronchoscopic performance efficiency. The secondary outcome measures were DC, PT, SP, and SR. Nineteen participants were randomized to the AIG and 21 participants to the ETG. MIT, PT, and SR were significantly better in the AIG compared to the ETG (median difference, p): MIT (-7.9 s, 0.027), PT (-77 s, 0.022), SR (-7 segments, 0.019); all showing moderate effect sizes (0.35, 0.36, and 0.37, respectively) as per Cohen's classification.There was no significant difference between the groups for all other final test measures.MEASUREMENTS AND MAIN RESULTS:Mean intersegmental time (MIT = PT/DC), diagnostic completeness (DC), procedure time (PT), structured progress (SP), and number of segments revisited (SR) were measured. The primary outcome measure assessed was MIT, a measure of bronchoscopic performance efficiency. The secondary outcome measures were DC, PT, SP, and SR. Nineteen participants were randomized to the AIG and 21 participants to the ETG. MIT, PT, and SR were significantly better in the AIG compared to the ETG (median difference, p): MIT (-7.9 s, 0.027), PT (-77 s, 0.022), SR (-7 segments, 0.019); all showing moderate effect sizes (0.35, 0.36, and 0.37, respectively) as per Cohen's classification.There was no significant difference between the groups for all other final test measures.CONCLUSIONS:Training using an AI system resulted in faster and more efficient bronchoscopy performance by critical-care physicians when compared to expert human tutor instruction. This could change the future of bronchoscopy training in critical care and warrants validation in patients through clinical studies.