Skin lesion segmentation via generative adversarial networks with dual discriminators

被引:185
作者
Lei, Baiying [1 ]
Xia, Zaimin [1 ]
Jiang, Feng [1 ]
Jiang, Xudong [2 ]
Ge, Zongyuan [3 ]
Xu, Yanwu [4 ]
Qin, Jing [5 ]
Chen, Siping [1 ]
Wang, Tianfu [1 ]
Wang, Shuqiang [6 ]
机构
[1] Shenzhen Univ, Natl Reg Key Technol Engn Lab Med Ultrasound, Guangdong Key Lab Biomed Measurements & Ultrasoun, Sch Biomed Engn,Hlth Sci Ctr, Shenzhen, Peoples R China
[2] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[3] Monash Univ, Monash eRes Ctr, Clayton, Vic, Australia
[4] Chinese Acad Sci, Ningbo Inst Ind Technol, Ningbo, Peoples R China
[5] Hong Kong Polytech Univ, Sch Nursing, Ctr Smart Hlth, Hong Kong, Peoples R China
[6] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518000, Peoples R China
基金
中国国家自然科学基金;
关键词
Skin lesion segmentation; Generative adversarial network; Dense convolution U-Net; Dual discriminators; CLASSIFICATION; DIAGNOSIS;
D O I
10.1016/j.media.2020.101716
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Skin lesion segmentation from dermoscopy images is a fundamental yet challenging task in the computer-aided skin diagnosis system due to the large variations in terms of their views and scales of lesion areas. We propose a novel and effective generative adversarial network (GAN) to meet these challenges. Specifically, this network architecture integrates two modules: a skip connection and dense convolution U-Net (UNet-SCDC) based segmentation module and a dual discrimination (DD) module. While the UNet-SCDC module uses dense dilated convolution blocks to generate a deep representation that preserves fine-grained information, the DD module makes use of two discriminators to jointly decide whether the input of the discriminators is real or fake. While one discriminator, with a traditional adversarial loss, focuses on the differences at the boundaries of the generated segmentation masks and the ground truths, the other examines the contextual environment of target object in the original image using a conditional discriminative loss. We integrate these two modules and train the proposed GAN in an end-to-end manner. The proposed GAN is evaluated on the public International Skin Imaging Collaboration (ISIC) Skin Lesion Challenge Datasets of 2017 and 2018. Extensive experimental results demonstrate that the proposed network achieves superior segmentation performance to state-of-the-art methods. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 58 条
[1]  
[Anonymous], Vision and Pattern Recognition (CVPR)
[2]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[3]  
Attia M., 2017, SPATIALLY AWARE MELA
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]  
Bi L., 2017, arXiv
[6]   Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks [J].
Bi, Lei ;
Kim, Jinman ;
Ahn, Euijoon ;
Kumar, Ashnil ;
Fulham, Michael ;
Feng, Dagan .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (09) :2065-2074
[7]   EPILUMINESCENCE MICROSCOPY - A USEFUL TOOL FOR THE DIAGNOSIS OF PIGMENTED SKIN-LESIONS FOR FORMALLY TRAINED DERMATOLOGISTS [J].
BINDER, M ;
SCHWARZ, M ;
WINKLER, A ;
STEINER, A ;
KAIDER, A ;
WOLFF, K ;
PEHAMBERGER, H .
ARCHIVES OF DERMATOLOGY, 1995, 131 (03) :286-291
[8]   A methodological approach to the classification of dermoscopy images [J].
Celebi, M. Emre ;
Kingravi, Hassan A. ;
Uddin, Bakhtiyar ;
Lyatornid, Hitoshi ;
Aslandogan, Y. Alp ;
Stoecker, William V. ;
Moss, Randy H. .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2007, 31 (06) :362-373
[9]   CaMap: Camera-based Map Manipulation on Mobile Devices [J].
Chen, Liang ;
Chen, Dongyi .
PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2018), 2018,
[10]  
Codella NCF, 2017, 2017 INT S BIOM IM I