TNN: Tree Neural Network for Airway Anatomical Labeling

被引:9
|
作者
Yu, Weihao [1 ,2 ]
Zheng, Hao [1 ,2 ,3 ,4 ]
Gu, Yun [1 ,2 ,5 ]
Xie, Fangfang [6 ,7 ]
Yang, Jie [1 ,2 ]
Sun, Jiayuan [6 ,7 ]
Yang, Guang-Zhong [1 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Inst Med Robot, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Inst Image Proc & Pattern Recognit, Shanghai 200240, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200240, Peoples R China
[4] Tencent Jarvis Lab, Shenzhen 518057, Peoples R China
[5] Shanghai Ctr forBrain Sci & Brain Inspired Technol, Shanghai 201602, Peoples R China
[6] Shanghai Chest Hosp, Shanghai Engn Res Ctr Resp Endoscopy, Dept Resp & Crit Care Med, Shanghai 200052, Peoples R China
[7] Shanghai Chest Hosp, Dept Resp Endoscopy, Shanghai 200052, Peoples R China
关键词
Airway anatomical labeling; hypergraph neural network; hyperedge interaction; overlapping distribution;
D O I
10.1109/TMI.2022.3204538
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Detailed anatomical labeling of bronchial trees extracted from CT images can be used as fine-grained maps for intra-operative navigation. To cater to the sparse distribution of airway voxels and large class imbalance in 3D image space, a graph-neural-network-based method is proposed to map branches to nodes in a graph space and assign anatomical labels down to subsegmental level. To address the inherent problem of overlapping distribution of positional and morphological features, especially for subsegmental categories, the proposed method focuses on the relative position between sibling subsegments which is fixed in most cases. The hierarchical nomenclature is represented by multi-level labeling and each category is associated with one or two subtrees in the graph. Hyperedges are used to extract the representation of subtrees while a hypergraph neural network is developed to encode their intrinsic relationship through hyperedge interaction. A filter module is further designed to guide feature aggregation between nodes and hyperedges. With the proposed method, the final accuracies for segmental and subsegmental node classification can achieve 93.6% and 82.0% respectively.
引用
收藏
页码:103 / 118
页数:16
相关论文
共 50 条
  • [1] Matching and anatomical labeling of human airway tree
    Tschirren, J
    McLennan, G
    Palágyi, K
    Hoffman, EA
    Sonka, M
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2005, 24 (12) : 1540 - 1547
  • [2] Robust Segmentation and Anatomical Labeling of the Airway Tree from Thoracic CT Scans
    van Ginneken, Bram
    Baggerman, Wouter
    van Rikxoort, Eva M.
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2008, PT I, PROCEEDINGS, 2008, 5241 : 219 - 226
  • [3] Structure and position-aware graph neural network for airway labeling
    Xie, Weiyi
    Jacobs, Colin
    Charbonnier, Jean-Paul
    van Ginneken, Bram
    MEDICAL IMAGE ANALYSIS, 2024, 97
  • [4] Distinguishing bronchoscopically observed anatomical positions of airway under by convolutional neural network
    Chen, Chongxiang
    Herth, Felix J. F.
    Zuo, Yingnan
    Li, Hongjia
    Liang, Xinyuan
    Chen, Yaqing
    Ren, Jiangtao
    Jian, Wenhua
    Zhong, Changhao
    Li, Shiyue
    THERAPEUTIC ADVANCES IN CHRONIC DISEASE, 2023, 14
  • [5] A Hierarchical Scheme for Geodesic Anatomical Labeling of Airway Trees
    Feragen, Aasa
    Petersen, Jens
    Owen, Megan
    Lo, Pechin
    Thomsen, Laura H.
    Wille, Mathilde M. W.
    Dirksen, Asger
    de Bruijne, Marleen
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2012, PT III, 2012, 7512 : 147 - 155
  • [6] A novel application of transformer neural network (TNN) for estimating pan evaporation rate
    Abed, Mustafa
    Imteaz, Monzur Alam
    Ahmed, Ali Najah
    Huang, Yuk Feng
    APPLIED WATER SCIENCE, 2023, 13 (02)
  • [7] A novel application of transformer neural network (TNN) for estimating pan evaporation rate
    Mustafa Abed
    Monzur Alam Imteaz
    Ali Najah Ahmed
    Yuk Feng Huang
    Applied Water Science, 2023, 13
  • [8] AIRWAY LABELING USING A HIDDEN MARKOV TREE MODEL
    Ross, James C.
    Diaz, Alejandro A.
    Okajima, Yuka
    Wassermann, Demian
    Washko, George R.
    Dy, Jennifer
    Estepar, Raul San Jose
    2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI), 2014, : 554 - 558
  • [9] Anatomical traits of Cryptomeria japonica tree rings studied by wavelet convolutional neural network
    Nakajima, T.
    Kobayashi, K.
    Sugiyama, J.
    INTERNATIONAL CONFERENCE ON FOREST PRODUCTS (ICFP) 2019: ADOPTING THE RENEWABLE BIOENERGY AND WASTE UTILIZATION TO SUPPORT CIRCULAR ECONOMY AND SUSTAINABLE ENVIRONMENT (INAFOR EXPO 2019), 2020, 415
  • [10] Evolutionary design of neural network tree - Integration of decision tree, neural network and GA
    Zhao, QF
    PROCEEDINGS OF THE 2001 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2001, : 240 - 244