Early detection and classification of abnormality in prior mammograms using image-to-image translation and YOLO techniques

被引:25
作者
Baccouche, Asma [1 ]
Garcia-Zapirain, Begonya [2 ]
Zheng, Yufeng [3 ]
Elmaghraby, Adel S. [1 ]
机构
[1] Univ Louisville, Dept Comp Sci & Engn, Louisville, KY 40292 USA
[2] Univ Deusto, eVida Res Grp, Bilbao 4800, Spain
[3] Univ Mississippi, Med Ctr, Jackson, MS 39216 USA
关键词
Breast cancer; Detection; Classification; YOLO; Prior mammogram; Early diagnosis; COMPUTER-AIDED DETECTION; BREAST-CANCER; ARTIFICIAL-INTELLIGENCE; DIGITAL MAMMOGRAMS; LESIONS; FUSION; MASSES; FULL;
D O I
10.1016/j.cmpb.2022.106884
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Computer-aided-detection (CAD) systems have been developed to assist radiologists on finding suspicious lesions in mammogram. Deep Learning technology have recently succeeded to increase the chance of recognizing abnormality at an early stage in order to avoid unnecessary biopsies and decrease the mortality rate. In this study, we investigated the effectiveness of an end-to-end fusion model based on You-Only-Look-Once (YOLO) architecture, to simultaneously detect and classify suspicious breast lesions on digital mammograms. Four categories of cases were included: Mass, Calcification, Architectural Distortions, and Normal from a private digital mammographic database including 413 cases. For all cases, Prior mammograms (typically scanned 1 year before) were all reported as Normal, while Current mammograms were diagnosed as cancerous (confirmed by biopsies) or healthy. Methods: We propose to apply the YOLO-based fusion model to the Current mammograms for breast lesions detection and classification. Then apply the same model retrospectively to synthetic mammograms for an early cancer prediction, where the synthetic mammograms were generated from the Prior mammograms by using the image-to-image translation models, CycleGAN and Pix2Pix. Results: Evaluation results showed that our methodology could significantly detect and classify breast lesions on Current mammograms with a highest rate of 93% +/- 0.118 for Mass lesions, 88% +/- 0.09 for Calcification lesions, and 95% +/- 0.06 for Architectural Distortion lesions. In addition, we reported evaluation results on Prior mammograms with a highest rate of 36% +/- 0.01 for Mass lesions, 14% +/- 0.01 for Calcification lesions, and 50% +/- 0.02 for Architectural Distortion lesions. Normal mammograms were accordingly classified with an accuracy rate of 92% +/- 0.09 and 90% +/- 0.06 respectively on Current and Prior exams. Conclusions: Our proposed framework was first developed to help detecting and identifying suspicious breast lesions in X-ray mammograms on their Current screening. The work was also suggested to reduce the temporal changes between pairs of Prior and follow-up screenings for early predicting the location and type of abnormalities in Prior mammogram screening. The paper presented a CAD method to assist doctors and experts to identify the risk of breast cancer presence. Overall, the proposed CAD method incorporates the advances of image processing, deep learning and image-to-image translation for a biomedical application.
引用
收藏
页数:17
相关论文
共 54 条
[1]   Automatic mass detection in mammograms using deep convolutional neural networks [J].
Agarwal, Richa ;
Diaz, Oliver ;
Llado, Xavier ;
Yap, Moi Hoon ;
Marti, Robert .
JOURNAL OF MEDICAL IMAGING, 2019, 6 (03)
[2]   Evaluation of deep learning detection and classification towards computer-aided diagnosis of breast lesions in digital X-ray mammograms [J].
Al-antari, Mugahed A. ;
Han, Seung-Moo ;
Kim, Tae-Seong .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 196
[3]  
Al-masni MA, 2017, IEEE ENG MED BIO, P1230, DOI 10.1109/EMBC.2017.8037053
[4]   Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system [J].
Al-masni, Mohammed A. ;
Al-antari, Mugahed A. ;
Park, Jeong-Min ;
Gi, Geon ;
Kim, Tae-Yeon ;
Rivera, Patricio ;
Valarezo, Edwin ;
Choi, Mun-Taek ;
Han, Seung-Moo ;
Kim, Tae-Seong .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 157 :85-94
[5]   YOLO Based Breast Masses Detection and Classification in Full-Field Digital Mammograms [J].
Aly, Ghada Hamed ;
Marey, Mohammed ;
El-Sayed, Safaa Amin ;
Tolba, Mohamed Fahmy .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 200 (200)
[6]  
American Cancer Society, 2020, CANC FACTS FIGURES 2
[7]  
Arancibia Hernandez Patricia Lorena., 2016, Rev. Chil. Radiol, V22, P80, DOI 10.1016/j.rchira.2016.06.004
[8]   Connected-UNets: a deep learning architecture for breast mass segmentation [J].
Baccouche, Asma ;
Garcia-Zapirain, Begonya ;
Olea, Cristian Castillo ;
Elmaghraby, Adel S. .
NPJ BREAST CANCER, 2021, 7 (01)
[9]   Breast Lesions Detection and Classification via YOLO-Based Fusion Models [J].
Baccouche, Asma ;
Garcia-Zapirain, Begonya ;
Olea, Cristian Castillo ;
Elmaghraby, Adel S. .
CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 69 (01) :1407-1425
[10]  
Benny R., 2020, Prog. Electromagn. Res. B, V87, P61, DOI [DOI 10.2528/PIERB20012402, 10.2528/PIERB20012402]