Identification of COPD From Multi-View Snapshots of 3D Lung Airway Tree via Deep CNN

被引:28
作者
Du, Ran [1 ]
Qi, Shouliang [1 ,2 ,3 ]
Feng, Jie [4 ]
Xia, Shuyue [5 ]
Kang, Yan [1 ]
Qian, Wei [6 ]
Yao, Yu-Dong [7 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Minist Educ, Key Lab Med Image Comp, Shenyang 110169, Peoples R China
[3] Neusoft Res Intelligent Healthcare Technol Co Ltd, Shenyang 110169, Peoples R China
[4] Shengyang Univ Technol, Sch Chem Equipment, Liaoyang 111003, Peoples R China
[5] Shenyang Med Coll, Cent Hosp, Resp Dept, Shenyang 110024, Peoples R China
[6] Univ Texas El Paso, Coll Engn, El Paso, TX 79902 USA
[7] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
中国国家自然科学基金;
关键词
Computed tomography; Atmospheric modeling; Lung; Three-dimensional displays; Biomedical imaging; Diseases; Visualization; Chronic obstructive pulmonary disease (COPD); deep learning; convolutional neural networks; computed tomography (CT); airway; image classification; OBSTRUCTIVE PULMONARY-DISEASE; VISUAL ASSESSMENT; CT; QUANTIFICATION; DIMENSIONS; MANAGEMENT; PHENOTYPES; EMPHYSEMA; DIAGNOSIS; ANATOMY;
D O I
10.1109/ACCESS.2020.2974617
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chronic obstructive pulmonary disease (COPD) is associated with morphologic abnormalities of airways with various patterns and severities. However, the way of effectively representing these abnormalities is lacking and whether these abnormalities enable to distinguish COPD from healthy controls is unknown. We propose to use deep convolutional neural network (CNN) to assess 3D lung airway tree from the perspective of computer vision, thereby constructing models of identifying COPD. After extracting airway trees from CT images, snapshots of their 3D visualizations are obtained from ventral, dorsal and isometric views. Using snapshots of each view, one deep CNN model is constructed and further optimized by Bayesian optimization algorithm to indentify COPD. The majority voting of three views presents the final prediction. Finally, the class-discriminative localization maps have been drawn to visually explain the CNNs& x2019; decisions. The models trained with single view (ventral, dorsal and isometric) of colorful snapshots present the similar accuracy (ACC) (86.8& x0025;, 87.5& x0025; and 86.7& x0025;) and the model after voting achieves the ACC of 88.2& x0025;. The ACC of the final voting model using gray and binary snapshots achieves 88.6& x0025; and 86.4& x0025;, respectively. Our specially designed CNNs outperform the typical off-the-shelf CNNs and the pre-trained CNNs with fine tuning. The class-discriminative regions of COPD are mainly located at central airways; however, regions in HC are scattering and located at peripheral airways. It is feasible to identify COPD using snapshots of 3D lung airway tree extracted from CT images via deep CNN. The CNNs can represent the abnormalities of airway tree in COPD and make accurate CT-based diagnosis of COPD.
引用
收藏
页码:38907 / 38919
页数:13
相关论文
共 50 条
  • [41] Prior-Guided Multi-View 3D Head Reconstruction
    Wang, Xueying
    Guo, Yudong
    Yang, Zhongqi
    Zhang, Juyong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4028 - 4040
  • [42] Learning Disentangled Representation for Multi-View 3D Object Recognition
    Huang, Jingjia
    Yan, Wei
    Li, Ge
    Li, Thomas
    Liu, Shan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 646 - 659
  • [43] MVPN: Multi-View Prototype Network for 3D Shape Recognition
    Wu, Zizhao
    Yang, Ping
    Wang, Yigang
    IEEE ACCESS, 2019, 7 : 130363 - 130372
  • [44] Multi-view convolutional vision transformer for 3D object recognition
    Li, Jie
    Liu, Zhao
    Li, Li
    Lin, Junqin
    Yao, Jian
    Tu, Jingmin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [45] Multi-view dual attention network for 3D object recognition
    Wenju Wang
    Yu Cai
    Tao Wang
    Neural Computing and Applications, 2022, 34 : 3201 - 3212
  • [46] Multi-view dual attention network for 3D object recognition
    Wang, Wenju
    Cai, Yu
    Wang, Tao
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (04) : 3201 - 3212
  • [47] Combining voxel and normal predictions for multi-view 3D sketching
    Delanoy, Johanna
    Coeurjolly, David
    Lachaud, Jacques-Olivier
    Bousseau, Adrien
    COMPUTERS & GRAPHICS-UK, 2019, 82 : 65 - 72
  • [48] Pruning multi-view stereo net for efficient 3D reconstruction
    Xiang, Xiang
    Wang, Zhiyuan
    Lao, Shanshan
    Zhang, Baochang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 168 (168) : 17 - 27
  • [49] Deformable convolutional networks for multi-view 3D shape classification
    Ma, Pengfei
    Ma, Jie
    Wang, Xujiao
    Yang, Lichuang
    Wang, Nannan
    ELECTRONICS LETTERS, 2018, 54 (24) : 1373 - 1374
  • [50] Self-supervised Multi-view Learning via Auto-encoding 3D Transformations
    Gao, Xiang
    Hu, Wei
    Qi, Guo-Jun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (01)