Generative Adversarial Learning for Reducing Manual Annotation in Semantic Segmentation on Large Scale Miscroscopy Images: Automated Vessel Segmentation in Retinal Fundus Image as Test Case

被引:52
作者
Lahiri, Avisek [1 ]
Ayush, Kumar [1 ]
Biswas, Prabir Kumar [1 ]
Mitra, Pabitra [1 ]
机构
[1] Indian Inst Technol, Kharagpur 721302, W Bengal, India
来源
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) | 2017年
关键词
NEURAL-NETWORKS; BLOOD-VESSELS; CLASSIFICATION;
D O I
10.1109/CVPRW.2017.110
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Network(CNN) based semantic segmentation require extensive pixel level manual annotation which is daunting for large microscopic images. The paper is aimed towards mitigating this labeling effort by leveraging the recent concept of generative adversarial network(GAN) wherein a generator maps latent noise space to realistic images while a discriminator differentiates between samples drawn from database and generator. We extend this concept to a multi task learning wherein a discriminator-classifier network differentiates between fake/real examples and also assigns correct class labels. Though our concept is generic, we applied it for the challenging task of vessel segmentation in fundus images. We show that proposed method is more data efficient than a CNN. Specifically, with 150K, 30K and 15K training examples, proposed method achieves mean AUC of 0.962, 0.945 and 0.931 respectively, whereas the simple CNN achieves AUC of 0.960, 0.921 and 0.916 respectively.
引用
收藏
页码:794 / 800
页数:7
相关论文
共 39 条
[1]  
[Anonymous], 2016, ENSEMBLE DEEP CONVOL
[2]  
Argyriou A., 2007, Advances in Neural Information Processing Systems, P41
[3]  
Caruana R, 1998, LEARNING TO LEARN, P95, DOI 10.1007/978-1-4615-5529-2_5
[4]  
Ciresan D., 2012, Advances in Neural Information Processing Systems 25 (NIPS 2012), P1
[5]   RETINAL VESSEL SEGMENTATION VIA DEEP LEARNING NETWORK AND FULLY-CONNECTED CONDITIONAL RANDOM FIELDS [J].
Fu, Huazhu ;
Xu, Yanwu ;
Wong, Damon Wing Kee ;
Liu, Jiang .
2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, :698-701
[6]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[7]   A divide et impera strategy for automatic classification of retinal vessels into arteries and veins [J].
Grisan, E ;
Ruggeri, A .
PROCEEDINGS OF THE 25TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-4: A NEW BEGINNING FOR HUMAN HEALTH, 2003, 25 :890-893
[8]   Detection of the foveal avascular zone on retinal angiograms using Markov random fields [J].
Haddouche, A. ;
Adel, M. ;
Rasigni, M. ;
Conrath, J. ;
Bourennane, S. .
DIGITAL SIGNAL PROCESSING, 2010, 20 (01) :149-154
[9]  
Ioffe Sergey, 2015, PROC INT C MACH LEAR, V37, P448, DOI DOI 10.48550/ARXIV.1502.03167
[10]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711