Evaluation of the effect of computer aided diagnosis system on breast ultrasound for inexperienced radiologists in describing and determining breast lesions

Aim: To investigate the effect of a computer-aided diagnosis (CAD) system on breast ultrasound (US) for inexperienced radiologists in describing and determining breast lesions. Materials and methods: Between October 2015 to January 2017. 500 suspicious or probable benign lesions in 413 patients were reviewed, Five experienced readers retrospectively reviewed for each of 100 lesions according to the Breast Imaging Reporting and Data System (BI-BADS) lexicon and category, with CAD system (S-detectTM). The readers them made final decisions by combining CAD results to their US results. Using the nested experiment design, five inexperienced readers were asked to select the appropriate BI-RADS lexicons, categories. CAL) results, and combination results for each of the 100 lesions, retrospectively. Diagnostic peribrmance of experienced and inexperienced radiologists and CAD were assessed. For each case, agreements in the lexicons and categories were analyzed among the experienced reader, inexperienced reader and CAL). Results: Indicators of the diagnostic performance for breast malignancy of the experienced group (AUC=0.83, 95%CI [0.80, 0.86]) were similar or higher than those of CAD (AUC = 0.79, 95%CI [0.74, 0.83], p=0.101), except for specificity. Conversely, indicators of diagnostic performance of inexperienced group (AUC=0.65, 95%CI[0.58, 0.71]) did not differ from or were lower than those of CAD(AUC=0.73, 95%CI[0.67, 0.78], p=0.013). Also, the diagnostic performance of the inexperienced group after combination with the CAD result was significantly improved (0.71, 95% CI [0.65, 0.77], p=0.001), whereas that of the experienced group did not change after combination with the CAD result, except for specificity and positive predictive value (PPV). Kappa values for the agreement of the categorization between CAD and each radiologist group were increased after applying the CAD result to their result of general US. Especially, the increase of the Kappa value was higher in the inexperienced group than in the experienced group. Also, for all the lexicons, the Kappa values between the experienced group and CAD were higher than those between the inexperienced group and CAD. Conclusion: By using the CAD system for classification of breast lesions, diagnostic performance of the inexperienced radiologists for malignancy was significantly improved, and better agreement was observed in lexicons between the experienced group and CAL) than between the inexperienced group and CAD. CAD may be beneficial and educational for the inexperienced group.