Convolutional neural network-based segmentation network applied to image recognition of angiodysplasias lesion under capsule endoscopy

被引:11
作者
Chu, Ye [1 ]
Huang, Fang [2 ]
Gao, Min [2 ]
Zou, Duo-Wu [1 ]
Zhong, Jie [1 ]
Wu, Wei [1 ]
Wang, Qi [1 ]
Shen, Xiao-Nan [1 ]
Gong, Ting-Ting [1 ]
Li, Yuan-Yi [2 ]
Wang, Li-Fu [1 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Med, Ruijin Hosp, Dept Gastroenterol, Shanghai 200025, Peoples R China
[2] Jinshan Sci & Technol Grp Co Ltd, Technol Platform Dept, Chongqing 401120, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Med, Ruijin Hosp, Dept Gastroenterol, 197 Ruijin Er Rd, Shanghai 200025, Peoples R China
关键词
Artificial intelligence; Image segmentation; Capsule endoscopy; Angiodysplasias; DEVICE-ASSISTED ENTEROSCOPY; DISORDERS EUROPEAN-SOCIETY; ARTIFICIAL-INTELLIGENCE; DIAGNOSIS;
D O I
10.3748/wjg.v29.i5.879
中图分类号
R57 [消化系及腹部疾病];
学科分类号
摘要
BACKGROUNDSmall intestinal vascular malformations (angiodysplasias) are common causes of small intestinal bleeding. While capsule endoscopy has become the primary diagnostic method for angiodysplasia, manual reading of the entire gastrointestinal tract is time-consuming and requires a heavy workload, which affects the accuracy of diagnosis.AIMTo evaluate whether artificial intelligence can assist the diagnosis and increase the detection rate of angiodysplasias in the small intestine, achieve automatic disease detection, and shorten the capsule endoscopy (CE) reading time.METHODSA convolutional neural network semantic segmentation model with a feature fusion method, which automatically recognizes the category of vascular dysplasia under CE and draws the lesion contour, thus improving the efficiency and accuracy of identifying small intestinal vascular malformation lesions, was proposed. Resnet-50 was used as the skeleton network to design the fusion mechanism, fuse the shallow and depth features, and classify the images at the pixel level to achieve the segmentation and recognition of vascular dysplasia. The training set and test set were constructed and compared with PSPNet, Deeplab3+, and UperNet.RESULTSThe test set constructed in the study achieved satisfactory results, where pixel accuracy was 99%, mean intersection over union was 0.69, negative predictive value was 98.74%, and positive predictive value was 94.27%. The model parameter was 46.38 M, the float calculation was 467.2 G, and the time length to segment and recognize a picture was 0.6 s.CONCLUSIONConstructing a segmentation network based on deep learning to segment and recognize angiodysplasias lesions is an effective and feasible method for diagnosing angiodysplasias lesions.
引用
收藏
页码:879 / 889
页数:11
相关论文
共 33 条
[1]   Application of Convolutional Neural Networks for Automated Ulcer Detection in Wireless Capsule Endoscopy Images [J].
Alaskar, Haya ;
Hussain, Abir ;
Al-Aseem, Nourah ;
Liatsis, Panos ;
Al-Jumeily, Dhiya .
SENSORS, 2019, 19 (06)
[2]   Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network [J].
Aoki, Tomonori ;
Yamada, Atsuo ;
Aoyama, Kazuharu ;
Saito, Hiroaki ;
Tsuboi, Akiyoshi ;
Nakada, Ayako ;
Niikura, Ryota ;
Fujishiro, Mitsuhiro ;
Oka, Shiro ;
Ishihara, Soichiro ;
Matsuda, Tomoki ;
Tanaka, Shinji ;
Koike, Kazuhiko ;
Tada, Tomohiro .
GASTROINTESTINAL ENDOSCOPY, 2019, 89 (02) :357-+
[3]   Localization strategies for robotic endoscopic capsules: a review [J].
Bianchi, Federico ;
Masaracchia, Antonino ;
Barjuei, Erfan Shojaei ;
Menciassi, Arianna ;
Arezzo, Alberto ;
Koulaouzidis, Anastasios ;
Stoyanov, Danail ;
Dario, Paolo ;
Ciuti, Gastone .
EXPERT REVIEW OF MEDICAL DEVICES, 2019, 16 (05) :381-403
[4]   Addressing priority challenges in the detection and assessment of colorectal polyps from capsule endoscopy and colonoscopy in colorectal cancer screening using machine learning [J].
Blanes-Vidal, Victoria ;
Baatrup, Gunnar ;
Nadimi, Esmaeil S. .
ACTA ONCOLOGICA, 2019, 58 :S29-S36
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   Emergent single-balloon enteroscopy for overt bleeding of small intestinal vascular malformation [J].
Chung, Chen-Shuan ;
Chen, Kuan-Chih ;
Chou, Yueh-Hung ;
Chen, Kuo-Hsin .
WORLD JOURNAL OF GASTROENTEROLOGY, 2018, 24 (01) :157-160
[7]   Computer-aided detection of small intestinal ulcer and erosion in wireless capsule endoscopy images [J].
Fan, Shanhui ;
Xu, Lanmeng ;
Fan, Yihong ;
Wei, Kaihua ;
Li, Lihua .
PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (16)
[8]   Artificial intelligence in luminal endoscopy [J].
Gulati, Shraddha ;
Emmanuel, Andrew ;
Patel, Mehul ;
Williams, Sophie ;
Haji, Amyn ;
Hayee, Bu'Hussain ;
Neumann, Helmut .
THERAPEUTIC ADVANCES IN GASTROINTESTINAL ENDOSCOPY, 2020, 13
[9]  
Hajabdollahi M, 2019, IEEE ENG MED BIO, P7227, DOI [10.1109/EMBC.2019.8857751, 10.1109/embc.2019.8857751]
[10]   Application of Artificial Intelligence in Capsule Endoscopy: Where Are We Now? [J].
Hwang, Youngbae ;
Park, Junseok ;
Lim, Yun Jeong ;
Chun, Hoon Jai .
CLINICAL ENDOSCOPY, 2018, 51 (06) :547-551