An innovative medical image synthesis based on dual GAN deep neural networks for improved segmentation quality

被引:11
作者
Beji, Ahmed [1 ]
Blaiech, Ahmed Ghazi [1 ,2 ]
Said, Mourad [3 ]
Ben Abdallah, Asma [1 ,4 ]
Bedoui, Mohamed Hedi [1 ]
机构
[1] Univ Monastir, Lab Technol & Imagerie Med, Fac Med Monastir, Monastir 5019, Tunisia
[2] Univ Sousse, Inst Super Sci Appl & Technol Sousse, Sousse 4003, Tunisia
[3] Ctr Med Int Carthage, Zone Tourist JINEN EL OUEST, Unite Radiol & Imagerie Med, Monastir 5000, Tunisia
[4] Univ Monastir, Inst Super Informat & Math, Monastir 5019, Tunisia
关键词
Deep learning; Generative adversarial network; Medical image synthesis; Segmentation;
D O I
10.1007/s10489-022-03682-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence networks, precisely deep learning, have emerged as a truly life-impacting potential in healthcare - particularly in the area of medical diagnosis - and have achieved ground-breaking results in data enhancement, augmentation and reconstruction. In this paper, we propose a novel pipeline of an architecture of Generative Adversarial Networks (GAN) for Improved Segmentation Quality to attain better detection, diagnosis and treatment of diseases. The proposed method consists in creating an extended medical image distribution that will not only augment the data but also contribute to the achievement of good results in semantic segmentation tasks for better computer-aided medical diagnosis. In fact, our method is based on a pipeline with two stages representing the Segmentation 2-GAN (Seg2GAN) architecture, for the synthetic data distribution generation to enhance the quality of input images, followed by the segmentation phase using the new data. To validate this approach, we demonstrate an efficient medical data synthesis for diverse segmentation structures: the blood vessels of the retinal and the coronary, and the knee cartilage. Quantitative evaluations are presented as accuracy, sensitivity, precision and a dice score for three datasets. The segmentation results show that using the new synthetic data improves the same model trained on original real images; e.g., the gain of dice score is around of 8%, 21% and 50% for the blood vessels of the retinal and the coronary and for the knee cartilage, respectively. These obtained results compete with the state-of-art on multiple performance metrics.
引用
收藏
页码:3381 / 3397
页数:17
相关论文
共 31 条
  • [1] Convolutional neural network with batch normalization for glioma and stroke lesion detection using MRI
    Amin, Javaria
    Sharif, Muhammad
    Anjum, Muhammad Almas
    Raza, Mudassar
    Bukhari, Syed Ahmad Chan
    [J]. COGNITIVE SYSTEMS RESEARCH, 2020, 59 : 304 - 311
  • [2] 2D object recognition: a comparative analysis of SIFT, SURF and ORB feature descriptors
    Bansal, Monika
    Kumar, Munish
    Kumar, Manish
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (12) : 18839 - 18857
  • [3] Impact of Enhancement for Coronary Artery Segmentation Based on Deep Learning Neural Network
    Blaiech, Ahmed Ghazi
    Mansour, Asma
    Kerkeni, Asma
    Bedoui, Mohamed Hedi
    Ben Abdallah, Asma
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, IBPRIA 2019, PT II, 2019, 11868 : 260 - 272
  • [4] End-to-End Adversarial Retinal Image Synthesis
    Costa, Pedro
    Galdran, Adrian
    Meyer, Maria Ines
    Niemeijer, Meindert
    Abramoff, Michael
    Mendonca, Ana Maria
    Campilho, Aurelio
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) : 781 - 791
  • [5] Dong Yang, 2017, Medical Image Computing and Computer Assisted Intervention MICCAI 2017. 20th International Conference. Proceedings: LNCS 10435, P507, DOI 10.1007/978-3-319-66179-7_58
  • [6] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [7] Image matching based on the adaptive redundant keypoint elimination method in the SIFT algorithm
    Hossein-Nejad, Zahra
    Agahi, Hamed
    Mahmoodzadeh, Azar
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2021, 24 (02) : 669 - 683
  • [8] ISOLA P, 2017, PROC CVPR IEEE, P5967, DOI [DOI 10.1109/CVPR.2017.632, 10.1109/CVPR.2017.632]
  • [9] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90
  • [10] Generative Adversarial Learning for Reducing Manual Annotation in Semantic Segmentation on Large Scale Miscroscopy Images: Automated Vessel Segmentation in Retinal Fundus Image as Test Case
    Lahiri, Avisek
    Ayush, Kumar
    Biswas, Prabir Kumar
    Mitra, Pabitra
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 794 - 800