Breast tumor segmentation and shape classification in mammograms using generative adversarial and convolutional neural network

被引:158
作者
Kumar Singh, Vivek [1 ]
Rashwan, Hatem A. [1 ]
Romani, Santiago [1 ]
Akram, Farhan [2 ]
Pandey, Nidhi [4 ]
Kamal Sarker, Md Mostafa [1 ]
Saleh, Adel [1 ]
Arenas, Meritxell [3 ]
Arquez, Miguel [3 ]
Puig, Domenec [1 ]
Torrents-Barrena, Jordina [1 ]
机构
[1] Univ Rovira & Virgili, Dept Comp Engn & Math, Tarragona, Spain
[2] ASTAR, Imaging Informat Div, Bioinformat Inst, Singapore, Singapore
[3] Hosp Univ St Joan, Reus, Spain
[4] Univ Rovira & Virgili, Dept Med & Hlth Sci, Tarragona, Spain
关键词
Mammograms; Conditional generative adversarial network; Convolutional neural network; Tumor segmentation and shape classification; COMPUTER-AIDED DETECTION; MASS;
D O I
10.1016/j.eswa.2019.112855
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mammogram inspection in search of breast tumors is a tough assignment that radiologists must carry out frequently. Therefore, image analysis methods are needed for the detection and delineation of breast tumors, which portray crucial morphological information that will support reliable diagnosis. In this paper, we proposed a conditional Generative Adversarial Network (cGAN) devised to segment a breast tumor within a region of interest (ROI) in a mammogram. The generative network learns to recognize the tumor area and to create the binary mask that outlines it. In turn, the adversarial network learns to distinguish between real (ground truth) and synthetic segmentations, thus enforcing the generative network to create binary masks as realistic as possible. The cGAN works well even when the number of training samples are limited. As a consequence, the proposed method outperforms several state-of-the-art approaches. Our working hypothesis is corroborated by diverse segmentation experiments performed on 1Nbreast and a private in-house dataset. The proposed segmentation model, working on an image crop containing the tumor as well as a significant surrounding area of healthy tissue (loose frame ROI), provides a high Dice coefficient and Intersection over Union (IoU) of 94% and 87%, respectively. In addition, a shape descriptor based on a Convolutional Neural Network (CNN) is proposed to classify the generated masks into four tumor shapes: irregular, lobular, oval and round. The proposed shape descriptor was trained on DDSM, since it provides shape ground truth (while the other two datasets does not), yielding an overall accuracy of 80%, which outperforms the current state-of-the-art. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 52 条
  • [1] Segmentation of Regions of Interest Using Active Contours with SPF Function
    Akram, Farhan
    Kim, Jeong Heon
    Lee, Chan-Gun
    Choi, Kwang Nam
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2015, 2015
  • [2] A fully integrated computer-aided diagnosis system for digital X-ray mammograms via deep learning detection, segmentation, and classification
    Al-antari, Mugahed A.
    Al-masni, Mohammed A.
    Choi, Mun-Taek
    Han, Seung-Moo
    Kim, Tae-Seong
    [J]. INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2018, 117 : 44 - 54
  • [3] [Anonymous], ASSESSMENT NOVEL MAS
  • [4] [Anonymous], 2017, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2017.632
  • [5] [Anonymous], 2017, IEEE P COMPUT VIS PA, DOI DOI 10.1109/CVPR.2017.16
  • [6] [Anonymous], 2015, PROC CVPR IEEE
  • [7] [Anonymous], ADV NEURAL INFORM PR, DOI DOI 10.1109/TPAMI.2016.2577031
  • [8] [Anonymous], 2018, ARXIV180100926
  • [9] [Anonymous], 2017, IEEE T PATTERN ANAL, DOI DOI 10.1109/TPAMI.2016.2644615
  • [10] [Anonymous], P SPIE