Deep learning for polyp recognition in wireless capsule endoscopy images

被引:140
作者
Yuan, Yixuan [1 ]
Meng, Max Q. -H. [1 ]
机构
[1] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
image manifold information; polyp recognition; stacked sparse autoencoder with image manifold (SSAEIM); wireless capsule endoscopy images;
D O I
10.1002/mp.12147
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: Wireless capsule endoscopy (WCE) enables physicians to examine the digestive tract without any surgical operations, at the cost of a large volume of images to be analyzed. In the computer-aided diagnosis of WCE images, the main challenge arises from the difficulty of robust characterization of images. This study aims to provide discriminative description of WCE images and assist physicians to recognize polyp images automatically. Methods: We propose a novel deep feature learning method, named stacked sparse autoencoder with image manifold constraint (SSAEIM), to recognize polyps in the WCE images. Our SSAEIM differs from the traditional sparse autoencoder (SAE) by introducing an image manifold constraint, which is constructed by a nearest neighbor graph and represents intrinsic structures of images. The image manifold constraint enforces that images within the same category share similar learned features and images in different categories should be kept far away. Thus, the learned features preserve large intervariances and small intravariances among images. Results: The average overall recognition accuracy (ORA) of our method for WCE images is 98.00%. The accuracies for polyps, bubbles, turbid images, and clear images are 98.00%, 99.50%, 99.00%, and 95.50%, respectively. Moreover, the comparison results show that our SSAEIM outperforms existing polyp recognition methods with relative higher ORA. Conclusion: The comprehensive results have demonstrated that the proposed SSAEIM can provide descriptive characterization for WCE images and recognize polyps in a WCE video accurately. This method could be further utilized in the clinical trials to help physicians from the tedious image reading work. (C) 2017 American Association of Physicists in Medicine
引用
收藏
页码:1379 / 1389
页数:11
相关论文
共 41 条
[1]   A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model [J].
Anthimopoulos, Marios M. ;
Gianola, Lauro ;
Scarnato, Luca ;
Diem, Peter ;
Mougiakakou, Stavroula G. .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2014, 18 (04) :1261-1271
[2]   Polyp Detection via Imbalanced Learning and Discriminative Feature Learning [J].
Bae, Seung-Hwan ;
Yoon, Kuk-Jin .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2015, 34 (11) :2379-2393
[3]   Automatic small bowel tumor diagnosis by using multi-scale wavelet-based analysis in wireless capsule endoscopy images [J].
Barbosa, Daniel C. ;
Roupar, Dalila B. ;
Ramos, Jaime C. ;
Tavares, Adriano C. ;
Lima, Carlos S. .
BIOMEDICAL ENGINEERING ONLINE, 2012, 11
[4]   MPEG-7 visual descriptors - Contributions for automated feature extraction in capsule endoscopy [J].
Coimbra, Miguel Tavares ;
Cunha, Joao Paulo Silva .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (05) :628-637
[5]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[6]  
El Khatib A, 2015, IEEE ENG MED BIO, P2669, DOI 10.1109/EMBC.2015.7318941
[7]  
Gueye L, 2015, IEEE IMAGE PROC, P1061, DOI 10.1109/ICIP.2015.7350962
[8]   A Completed Modeling of Local Binary Pattern Operator for Texture Classification [J].
Guo, Zhenhua ;
Zhang, Lei ;
Zhang, David .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (06) :1657-1663
[9]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[10]   A fast learning algorithm for deep belief nets [J].
Hinton, Geoffrey E. ;
Osindero, Simon ;
Teh, Yee-Whye .
NEURAL COMPUTATION, 2006, 18 (07) :1527-1554