Deep learning approach for discrimination of liver lesions using nine time-phase images of contrast-enhanced ultrasound

PurposeContrast-enhanced ultrasound (CEUS) shows different enhancement patterns depending on the time after administration of the contrast agent. The aim of this study was to evaluate the diagnostic performance of liver nodule characterization using our proposed deep learning model with input of nine CEUS images.MethodsA total of 181 liver lesions (48 benign, 78 hepatocellular carcinoma (HCC), and 55 non-HCC malignant) were included in this prospective study. CEUS were performed using the contrast agent Sonazoid, and in addition to B-mode images before injection, image clips were stored every minute up to 10 min. A deep learning model was developed by arranging three ResNet50 transfer learning models in parallel. This proposed model allowed inputting up to nine datasets of different phases of CEUS and performing image augmentation of nine images synchronously. Using the results, the correct prediction rate, sensitivity, and specificity between "benign" and "malignant" cases were analyzed for each combination of the time phase. These accuracy values were also compared with the washout score judged by a human.ResultsThe proposed model showed performance superior to the referential standard model when the dataset from B-mode to the 10-min images were used (sensitivity: 93.2%, specificity: 65.3%, average correct answer rate: 60.1%). It also maintained 90.2% sensitivity and 61.2% specificity even when the dataset was limited to 2 min after injection, and this accuracy was equivalent to or better than human scoring by experts.ConclusionOur proposed model has the potential to identify tumor types earlier than the Kupffer phase, but at the same time, machine learning confirmed that Kupffer-phase Sonazoid images contain essential information for the classification of liver nodules.