Polyp-Net: A Multimodel Fusion Network for Polyp Segmentation

被引:68
作者
Banik, Debapriya [1 ]
Roy, Kaushiki [1 ]
Bhattacharjee, Debotosh [1 ,2 ]
Nasipuri, Mita [1 ]
Krejcar, Ondrej [2 ,3 ]
机构
[1] Jadavpur Univ, Comp Sci & Engn Dept, Kolkata 700032, India
[2] Univ Hradec Kralove, Fac Informat & Management, Ctr Basic & Appl Sci, Hradec Kralove 50003, Czech Republic
[3] Univ Teknol Malaysia, Malaysia Japan Int Inst Technol MJIIT, Kuala Lumpur 54100, Malaysia
关键词
2-D dual-tree complex wavelet transform (2-D DT-CWT); colonoscopy; convolutional neural network (CNN); fusion; level-set method (LSM); polyp; segmentation; IMAGES;
D O I
10.1109/TIM.2020.3015607
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computer-aided diagnosis of disease primarily depends on proper vision-based measurement (VBM). The traditional approach followed for diagnosis of colorectal cancer includes a manual screening of colorectum via a colonoscope and resection of polyps for histopathological analysis to decide the grade of malignancy. This procedure is time-consuming and expensive, and removal of benign polyp for analysis signifies the inefficiency of the diagnosis system. These drawbacks inspired us to develop an automatic vision-based analysis method for preliminary in vivo malignancy analysis of the polyp region. In this work, we have proposed a fusion-based polyp segmentation network, namely, Polyp-Net. Recently, convolutional neural networks (CNNs) have shown immense success in the domain of medical image analysis as it can exploit in-depth significant features with high discrimination capabilities. Therefore, motivated by these insights, we have proposed an enriched version of CNN with a nascent pooling mechanism, namely dual-tree wavelet pooled CNN (DT-WpCNN). The resultant segmented mask contains some surplus high-intensity regions apart from the polyp region. These shortcomings are avoided using a new variation of the region-based level-set method, namely, the local gradient weighting-embedded level-set method (LGWe-LSM), which shows a significant reduction of false-positive rate. The pixel-level fusion of the two enhanced methods shows more potentiality in the segmentation of the polyp regions. Our proposed network is trained on CVC-colon DB and tested on CVC-clinic DB. It achieves a dice score of 0.839, volume-similarity of 0.863, precision of 0.836, recall of 0.811, F1-score of 0.823, F2-score of 0.815, and Hausdorff distance of 21.796 which outperforms the existing baseline CNN's and recent state-of-the-art methods.
引用
收藏
页数:12
相关论文
共 38 条
[1]  
[Anonymous], 2018, P INT JOINT C BIOM E
[2]  
Banik Debapriya, 2020, Advanced Computing and Systems for Security. Volume Twelve. Advances in Intelligent Systems and Computing (AISC 1136), P109, DOI 10.1007/978-981-15-2930-6_9
[3]   WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians [J].
Bernal, Jorge ;
Javier Sanchez, F. ;
Fernandez-Esparrach, Gloria ;
Gil, Debora ;
Rodriguez, Cristina ;
Vilarino, Fernando .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2015, 43 :99-111
[4]   Fully Convolutional Neural Networks for Polyp Segmentation in Colonoscopy [J].
Brandao, Patrick ;
Mazomenos, Evangelos ;
Ciuti, Gastone ;
Calio, Renato ;
Bianchi, Federico ;
Menciassi, Arianna ;
Dario, Paolo ;
Koulaouzidis, Anastasios ;
Arezzo, Alberto ;
Stoyanov, Danail .
MEDICAL IMAGING 2017: COMPUTER-AIDED DIAGNOSIS, 2017, 10134
[5]   Active contours without edges [J].
Chan, TF ;
Vese, LA .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (02) :266-277
[6]   Medical Measurements and Applications: 10 Years of Ideas and Innovation [J].
De Vito, Luca ;
Cortner, J. Max .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2017, 66 (10) :2502-2504
[7]   Digital inpainting based on the Mumford-Shah-Euler image model [J].
Esedoglu, S ;
Shen, JH .
EUROPEAN JOURNAL OF APPLIED MATHEMATICS, 2002, 13 :353-370
[8]   Automatic Segmentation of Polyps in Colonoscopic Narrow-Band Imaging Data [J].
Ganz, Melanie ;
Yang, Xiaoyun ;
Slabaugh, Greg .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (08) :2144-2151
[9]   Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities [J].
Ghafoorian, Mohsen ;
Karssemeijer, Nico ;
Heskes, Tom ;
van Uden, Inge W. M. ;
Sanchez, Clara I. ;
Litjens, Geert ;
de Leeuw, Frank-Erik ;
van Ginneken, Bram ;
Marchiori, Elena ;
Platel, Bram .
SCIENTIFIC REPORTS, 2017, 7
[10]   GIANA Polyp Segmentation with Fully Convolutional Dilation Neural Networks [J].
Guo, Yun Bo ;
Matuszewski, Bogdan J. .
VISAPP: PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4, 2019, :632-641