Deep learning-based differentiation of ventricular septal defect from tetralogy of Fallot in fetal echocardiography images

BACKGROUND: Congenital heart disease (CHD) seriously affects children's health and quality of life, and early detection of CHD can reduce its impact on children's health. Tetralogy of Fallot (TOF) and ventricular septal defect (VSD) are two types of CHD that have similarities in echocardiography. However, TOF has worse diagnosis and higher morality than VSD. Accurate differentiation between VSD and TOF is highly important for administrative property treatment and improving affected factors' diagnoses. OBJECTIVE: TOF and VSD were differentiated using convolutional neural network (CNN) models that classified fetal echocardiography images. METHODS: We collected 105 fetal echocardiography images of TOF and 96 images of VSD. Four CNN models, namely, VGG19, ResNet50, NTS-Net, and the weakly supervised data augmentation network (WSDAN), were used to differentiate the two congenital heart diseases. The performance of these four models was compared based on sensitivity, accuracy, specificity, and AUC. RESULTS: VGG19 and ResNet50 performed similarly, with AUCs of 0.799 and 0.802, respectively. A superior performance was observed with NTS-Net and WSDAN specific for fine-grained image categorization tasks, with AUCs of 0.823 and 0.873, respectively. WSDAN had the best performance among all models tested. CONCLUSIONS: WSDAN exhibited the best performance in differentiating between TOF and VSD and is worthy of further clinical popularization.