Identification of COPD From Multi-View Snapshots of 3D Lung Airway Tree via Deep CNN

被引:28
|
作者
Du, Ran [1 ]
Qi, Shouliang [1 ,2 ,3 ]
Feng, Jie [4 ]
Xia, Shuyue [5 ]
Kang, Yan [1 ]
Qian, Wei [6 ]
Yao, Yu-Dong [7 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Minist Educ, Key Lab Med Image Comp, Shenyang 110169, Peoples R China
[3] Neusoft Res Intelligent Healthcare Technol Co Ltd, Shenyang 110169, Peoples R China
[4] Shengyang Univ Technol, Sch Chem Equipment, Liaoyang 111003, Peoples R China
[5] Shenyang Med Coll, Cent Hosp, Resp Dept, Shenyang 110024, Peoples R China
[6] Univ Texas El Paso, Coll Engn, El Paso, TX 79902 USA
[7] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ 07030 USA
基金
中国国家自然科学基金;
关键词
Computed tomography; Atmospheric modeling; Lung; Three-dimensional displays; Biomedical imaging; Diseases; Visualization; Chronic obstructive pulmonary disease (COPD); deep learning; convolutional neural networks; computed tomography (CT); airway; image classification; OBSTRUCTIVE PULMONARY-DISEASE; VISUAL ASSESSMENT; CT; QUANTIFICATION; DIMENSIONS; MANAGEMENT; PHENOTYPES; EMPHYSEMA; DIAGNOSIS; ANATOMY;
D O I
10.1109/ACCESS.2020.2974617
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chronic obstructive pulmonary disease (COPD) is associated with morphologic abnormalities of airways with various patterns and severities. However, the way of effectively representing these abnormalities is lacking and whether these abnormalities enable to distinguish COPD from healthy controls is unknown. We propose to use deep convolutional neural network (CNN) to assess 3D lung airway tree from the perspective of computer vision, thereby constructing models of identifying COPD. After extracting airway trees from CT images, snapshots of their 3D visualizations are obtained from ventral, dorsal and isometric views. Using snapshots of each view, one deep CNN model is constructed and further optimized by Bayesian optimization algorithm to indentify COPD. The majority voting of three views presents the final prediction. Finally, the class-discriminative localization maps have been drawn to visually explain the CNNs& x2019; decisions. The models trained with single view (ventral, dorsal and isometric) of colorful snapshots present the similar accuracy (ACC) (86.8& x0025;, 87.5& x0025; and 86.7& x0025;) and the model after voting achieves the ACC of 88.2& x0025;. The ACC of the final voting model using gray and binary snapshots achieves 88.6& x0025; and 86.4& x0025;, respectively. Our specially designed CNNs outperform the typical off-the-shelf CNNs and the pre-trained CNNs with fine tuning. The class-discriminative regions of COPD are mainly located at central airways; however, regions in HC are scattering and located at peripheral airways. It is feasible to identify COPD using snapshots of 3D lung airway tree extracted from CT images via deep CNN. The CNNs can represent the abnormalities of airway tree in COPD and make accurate CT-based diagnosis of COPD.
引用
收藏
页码:38907 / 38919
页数:13
相关论文
共 50 条
  • [1] Deep CNN for COPD identification by Multi-View snapshot integration of 3D airway tree and lung field
    Wu, Yanan
    Du, Ran
    Feng, Jie
    Qi, Shouliang
    Pang, Haowen
    Xia, Shuyue
    Qian, Wei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [2] Multi-view secondary input collaborative deep learning for lung nodule 3D segmentation
    Dong, Xianling
    Xu, Shiqi
    Liu, Yanli
    Wang, Aihui
    Saripan, M. Iqbal
    Li, Li
    Zhang, Xiaolei
    Lu, Lijun
    CANCER IMAGING, 2020, 20 (01)
  • [3] Multi-view secondary input collaborative deep learning for lung nodule 3D segmentation
    Xianling Dong
    Shiqi Xu
    Yanli Liu
    Aihui Wang
    M. Iqbal Saripan
    Li Li
    Xiaolei Zhang
    Lijun Lu
    Cancer Imaging, 20
  • [4] Multi-View 3D Shape Recognition via Correspondence-Aware Deep Learning
    Xu, Yong
    Zheng, Chaoda
    Xu, Ruotao
    Quan, Yuhui
    Ling, Haibin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5299 - 5312
  • [5] 3D Sketching using Multi-View Deep Volumetric Prediction
    Delanoy, Johanna
    Aubry, Mathieu
    Isola, Phillip
    Efros, Alexei A.
    Bousseau, Adrien
    PROCEEDINGS OF THE ACM ON COMPUTER GRAPHICS AND INTERACTIVE TECHNIQUES, 2018, 1 (01)
  • [6] Review of multi-view 3D object recognition methods based on deep learning
    Qi, Shaohua
    Ning, Xin
    Yang, Guowei
    Zhang, Liping
    Long, Peng
    Cai, Weiwei
    Li, Weijun
    DISPLAYS, 2021, 69
  • [7] Aggregated Deep Convolutional Neural Networks for Multi-View 3D Object Retrieval
    Alzu'bi, Ahmad
    Abuarqoub, Abdelrahman
    Al-Hmouz, Ahmed
    2019 11TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT), 2019,
  • [8] From Multi-View to Hollow-3D: Hallucinated Hollow-3D R-CNN for 3D Object Detection
    Deng, Jiajun
    Zhou, Wengang
    Zhang, Yanyong
    Li, Houqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4722 - 4734
  • [9] Synthesis of Multi-View 3D Fingerprints to Advance Contactless Fingerprint Identification
    Dong, Chengdong
    Kumar, Ajay
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) : 13134 - 13151
  • [10] 3D Imaging Method for Multi-View Structured Light Measurement Via Deep Learning Pose Estimation
    Cui Haihua
    Jiang Tao
    Du Kunpeng
    Guo Ronghui
    Zhao An'an
    ACTA OPTICA SINICA, 2021, 41 (17)