Identification of COPD From Multi-View Snapshots of 3D Lung Airway Tree via Deep CNN

被引:28
作者
Du, Ran [1 ]
Qi, Shouliang [1 ,2 ,3 ]
Feng, Jie [4 ]
Xia, Shuyue [5 ]
Kang, Yan [1 ]
Qian, Wei [6 ]
Yao, Yu-Dong [7 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Minist Educ, Key Lab Med Image Comp, Shenyang 110169, Peoples R China
[3] Neusoft Res Intelligent Healthcare Technol Co Ltd, Shenyang 110169, Peoples R China
[4] Shengyang Univ Technol, Sch Chem Equipment, Liaoyang 111003, Peoples R China
[5] Shenyang Med Coll, Cent Hosp, Resp Dept, Shenyang 110024, Peoples R China
[6] Univ Texas El Paso, Coll Engn, El Paso, TX 79902 USA
[7] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
中国国家自然科学基金;
关键词
Computed tomography; Atmospheric modeling; Lung; Three-dimensional displays; Biomedical imaging; Diseases; Visualization; Chronic obstructive pulmonary disease (COPD); deep learning; convolutional neural networks; computed tomography (CT); airway; image classification; OBSTRUCTIVE PULMONARY-DISEASE; VISUAL ASSESSMENT; CT; QUANTIFICATION; DIMENSIONS; MANAGEMENT; PHENOTYPES; EMPHYSEMA; DIAGNOSIS; ANATOMY;
D O I
10.1109/ACCESS.2020.2974617
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chronic obstructive pulmonary disease (COPD) is associated with morphologic abnormalities of airways with various patterns and severities. However, the way of effectively representing these abnormalities is lacking and whether these abnormalities enable to distinguish COPD from healthy controls is unknown. We propose to use deep convolutional neural network (CNN) to assess 3D lung airway tree from the perspective of computer vision, thereby constructing models of identifying COPD. After extracting airway trees from CT images, snapshots of their 3D visualizations are obtained from ventral, dorsal and isometric views. Using snapshots of each view, one deep CNN model is constructed and further optimized by Bayesian optimization algorithm to indentify COPD. The majority voting of three views presents the final prediction. Finally, the class-discriminative localization maps have been drawn to visually explain the CNNs& x2019; decisions. The models trained with single view (ventral, dorsal and isometric) of colorful snapshots present the similar accuracy (ACC) (86.8& x0025;, 87.5& x0025; and 86.7& x0025;) and the model after voting achieves the ACC of 88.2& x0025;. The ACC of the final voting model using gray and binary snapshots achieves 88.6& x0025; and 86.4& x0025;, respectively. Our specially designed CNNs outperform the typical off-the-shelf CNNs and the pre-trained CNNs with fine tuning. The class-discriminative regions of COPD are mainly located at central airways; however, regions in HC are scattering and located at peripheral airways. It is feasible to identify COPD using snapshots of 3D lung airway tree extracted from CT images via deep CNN. The CNNs can represent the abnormalities of airway tree in COPD and make accurate CT-based diagnosis of COPD.
引用
收藏
页码:38907 / 38919
页数:13
相关论文
共 50 条
  • [31] MVTN: Learning Multi-view Transformations for 3D Understanding
    Hamdi, Abdullah
    AlZahrani, Faisal
    Giancola, Silvio
    Ghanem, Bernard
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (04) : 2197 - 2226
  • [32] A Bayesian Filter for Multi-View 3D Multi-Object Tracking With Occlusion Handling
    Ong, Jonah
    Ba-Tuong Vo
    Ba-Ngu Vo
    Kim, Du Yong
    Nordholm, Sven
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) : 2246 - 2263
  • [33] Multi-view 3D Reconstruction by Fusing Polarization Information
    Hu, Gaomei
    Zhao, Haimeng
    Hu, Qirun
    Zhu, Jianfang
    Yang, Peng
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 181 - 195
  • [34] Multi-view autostereoscopic system for 3D visualization in anatomy
    Magalhães D.S.F.
    Mansoor S.
    Weng Y.
    Ghizoni E.
    Barbosa T.
    Silveira F.A.
    Toledo R.S.
    Li L.M.
    Research on Biomedical Engineering, 2018, 34 (03) : 279 - 283
  • [35] Deep learning based multi-view stereo matching and 3D scene reconstruction from oblique aerial images
    Liu, Jin
    Gao, Jian
    Ji, Shunping
    Zeng, Chang
    Zhang, Shaoyi
    Gong, Jianya
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 204 : 42 - 60
  • [36] 3D Human Pose Estimation from multi-view thermal vision sensors
    Lupion, Marcos
    Polo-Rodriguez, Aurora
    Medina-Quero, Javier
    Sanjuan, Juan F.
    Ortigosa, Pilar M.
    INFORMATION FUSION, 2024, 104
  • [37] High-speed 3D shape measurement with the multi-view system using deep learning
    Yin, Wei
    Zuo, Chao
    Feng, Shijie
    Tao, Tianyang
    Chen, Qian
    OPTICAL METROLOGY AND INSPECTION FOR INDUSTRIAL APPLICATIONS VI, 2019, 11189
  • [38] DETransMVSnet: Research on Terahertz 3D Reconstruction of Multi-View Stereo Network With Deep Equilibrium Transformers
    Bai, Fan
    Li, Lun
    Wang, Wencheng
    Wu, Xiaojin
    IEEE ACCESS, 2023, 11 : 146042 - 146053
  • [39] A Progressive Multi-View Learning Approach for Multi-Loss Optimization in 3D Object Recognition
    Prasad, Shitala
    Li, Yiqun
    Lin, Dongyun
    Dong, Sheng
    Nwe, Ma Tin Lay
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 707 - 711
  • [40] Multi-view self-supervised learning for 3D facial texture reconstruction from single image
    Zeng, Xiaoxing
    Hu, Ruyun
    Shi, Wu
    Qiao, Yu
    IMAGE AND VISION COMPUTING, 2021, 115