Identification of COPD From Multi-View Snapshots of 3D Lung Airway Tree via Deep CNN

被引:28
|
作者
Du, Ran [1 ]
Qi, Shouliang [1 ,2 ,3 ]
Feng, Jie [4 ]
Xia, Shuyue [5 ]
Kang, Yan [1 ]
Qian, Wei [6 ]
Yao, Yu-Dong [7 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Minist Educ, Key Lab Med Image Comp, Shenyang 110169, Peoples R China
[3] Neusoft Res Intelligent Healthcare Technol Co Ltd, Shenyang 110169, Peoples R China
[4] Shengyang Univ Technol, Sch Chem Equipment, Liaoyang 111003, Peoples R China
[5] Shenyang Med Coll, Cent Hosp, Resp Dept, Shenyang 110024, Peoples R China
[6] Univ Texas El Paso, Coll Engn, El Paso, TX 79902 USA
[7] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
中国国家自然科学基金;
关键词
Computed tomography; Atmospheric modeling; Lung; Three-dimensional displays; Biomedical imaging; Diseases; Visualization; Chronic obstructive pulmonary disease (COPD); deep learning; convolutional neural networks; computed tomography (CT); airway; image classification; OBSTRUCTIVE PULMONARY-DISEASE; VISUAL ASSESSMENT; CT; QUANTIFICATION; DIMENSIONS; MANAGEMENT; PHENOTYPES; EMPHYSEMA; DIAGNOSIS; ANATOMY;
D O I
10.1109/ACCESS.2020.2974617
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chronic obstructive pulmonary disease (COPD) is associated with morphologic abnormalities of airways with various patterns and severities. However, the way of effectively representing these abnormalities is lacking and whether these abnormalities enable to distinguish COPD from healthy controls is unknown. We propose to use deep convolutional neural network (CNN) to assess 3D lung airway tree from the perspective of computer vision, thereby constructing models of identifying COPD. After extracting airway trees from CT images, snapshots of their 3D visualizations are obtained from ventral, dorsal and isometric views. Using snapshots of each view, one deep CNN model is constructed and further optimized by Bayesian optimization algorithm to indentify COPD. The majority voting of three views presents the final prediction. Finally, the class-discriminative localization maps have been drawn to visually explain the CNNs& x2019; decisions. The models trained with single view (ventral, dorsal and isometric) of colorful snapshots present the similar accuracy (ACC) (86.8& x0025;, 87.5& x0025; and 86.7& x0025;) and the model after voting achieves the ACC of 88.2& x0025;. The ACC of the final voting model using gray and binary snapshots achieves 88.6& x0025; and 86.4& x0025;, respectively. Our specially designed CNNs outperform the typical off-the-shelf CNNs and the pre-trained CNNs with fine tuning. The class-discriminative regions of COPD are mainly located at central airways; however, regions in HC are scattering and located at peripheral airways. It is feasible to identify COPD using snapshots of 3D lung airway tree extracted from CT images via deep CNN. The CNNs can represent the abnormalities of airway tree in COPD and make accurate CT-based diagnosis of COPD.
引用
收藏
页码:38907 / 38919
页数:13
相关论文
共 50 条
  • [21] Multi-View CNN Feature Aggregation with ELM Auto-Encoder for 3D Shape Recognition
    Yang, Zhi-Xin
    Tang, Lulu
    Zhang, Kun
    Wong, Pak Kin
    COGNITIVE COMPUTATION, 2018, 10 (06) : 908 - 921
  • [22] A general deep learning based framework for 3D reconstruction from multi-view stereo satellite images
    Gao, Jian
    Liu, Jin
    Ji, Shunping
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 195 : 446 - 461
  • [23] Fast fetal head compounding from multi-view 3D ultrasound
    Wright, Robert
    Gomez, Alberto
    Zimmer, Veronika A.
    Toussaint, Nicolas
    Khanal, Bishesh
    Matthew, Jacqueline
    Skelton, Emily
    Kainz, Bernhard
    Rueckert, Daniel
    V. Hajnal, Joseph
    Schnabel, Julia A.
    MEDICAL IMAGE ANALYSIS, 2023, 89
  • [24] MULTI-VIEW GAIT RECOGNITION USING 3D CONVOLUTIONAL NEURAL NETWORKS
    Wolf, Thomas
    Babaee, Mohammadreza
    Rigoll, Gerhard
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 4165 - 4169
  • [25] Multi-view 3D Models from Single Images with a Convolutional Network
    Tatarchenko, Maxim
    Dosovitskiy, Alexey
    Brox, Thomas
    COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 322 - 337
  • [26] Multi-View Hierarchical Fusion Network for 3D Object Retrieval and Classification
    Liu, An-An
    Hu, Nian
    Song, Dan
    Guo, Fu-Bin
    Zhou, He-Yu
    Hao, Tong
    IEEE ACCESS, 2019, 7 : 153021 - 153030
  • [27] Group-pair deep feature learning for multi-view 3d model retrieval
    Chen, Xiuxiu
    Liu, Li
    Zhang, Long
    Zhang, Huaxiang
    Meng, Lili
    Liu, Dongmei
    APPLIED INTELLIGENCE, 2022, 52 (02) : 2013 - 2022
  • [28] An Improved Multi-View Convolutional Neural Network for 3D Object Retrieval
    He, Xinwei
    Bai, Song
    Chu, Jiajia
    Bai, Xiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7917 - 7930
  • [29] MVPointNet: Multi-View Network for 3D Object Based on Point Cloud
    Zhou, Weiguo
    Jiang, Xin
    Liu, Yun-Hui
    IEEE SENSORS JOURNAL, 2019, 19 (24) : 12145 - 12152
  • [30] Conditions of a Multi-View 3D Display for Accurate Reproduction of Perceived Glossiness
    Sakano, Yuichi
    Ando, Hiroshi
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (10) : 3336 - 3350