Deep transfer learning approaches for bleeding detection in endoscopy images

被引:47
作者
Caroppo, Andrea [1 ]
Leone, Alessandro [1 ]
Siciliano, Pietro [1 ]
机构
[1] Natl Res Council Italy, Inst Microelect & Microsyst, I-73100 Lecce, Italy
关键词
Computer-aided; Bleeding detection; Wireless capsule endoscopy; Deep learning; Transfer learning; Convolutional neural network; WIRELESS-CAPSULE ENDOSCOPY; FEATURE-SELECTION; OCCULT;
D O I
10.1016/j.compmedimag.2020.101852
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Wireless capsule endoscopy is a non-invasive, wireless imaging tool that has developed rapidly over the last several years. One of the main limiting factors using this technology is that it produces a huge number of images, whose analysis, to be done by a doctor, is an extremely time-consuming process. In this research area, the management of this problem has been addressed with the development of Computer-aided Diagnosis systems thanks to which the automatic inspection and analysis of images acquired by the capsule has clearly improved. Recently, a big advance in classification of endoscopic images is achieved with the emergence of deep learning methods. The proposed expert system employs three pre-trained deep convolutional neural networks for feature extraction. In order to construct efficient feature sets, the features from VGG19, InceptionV3 and ResNet50 models are then selected and fused using the minimum Redundancy Maximum Relevance method and different fusion rules. Finally, supervised machine learning algorithms are employed to classify the images using the extracted features into two categories: bleeding and nonbleeding images. For performance evaluation a series of experiments are performed on two standard benchmark datasets. It has been observed that the proposed architecture outclass the single deep learning architectures, with an average accuracy in detection bleeding regions of 97.65 % and 95.70 % on well-known state-of-the-art datasets considering three different fusion rules, with the best combination in terms of accuracy and training time obtained using mean value pooling as fusion rule and Support Vector Machine as classifier.
引用
收藏
页数:15
相关论文
共 60 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[3]  
[Anonymous], P 3 INT C LEARNING R
[4]  
[Anonymous], 2016, INT WORKSH COMP ASS
[5]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[6]   Automatic detection of blood content in capsule endoscopy images based on a deep convolutional neural network [J].
Aoki, Tomonori ;
Yamada, Atsuo ;
Kato, Yusuke ;
Saito, Hiroaki ;
Tsuboi, Akiyoshi ;
Nakada, Ayako ;
Niikura, Ryota ;
Fujishiro, Mitsuhiro ;
Oka, Shiro ;
Ishihara, Soichiro ;
Matsuda, Tomoki ;
Nakahori, Masato ;
Tanaka, Shinji ;
Koike, Kazuhiko ;
Tada, Tomohiro .
JOURNAL OF GASTROENTEROLOGY AND HEPATOLOGY, 2020, 35 (07) :1196-1200
[7]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[8]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[9]   A Deep Learning Approach for Red Lesions Detection in Video Capsule Endoscopies [J].
Coelho, Paulo ;
Pereira, Ana ;
Leite, Argentina ;
Salgado, Marta ;
Cunha, Antonio .
IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 :553-561
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848