Unsupervised domain selective graph convolutional network for preoperative prediction of lymph node metastasis in gastric cancer

被引:8
作者
Zhang, Yongtao [1 ]
Yuan, Ning [2 ]
Zhang, Zhiguo [1 ]
Du, Jie [1 ]
Wang, Tianfu [1 ]
Liu, Bing [3 ]
Yang, Aocai [3 ]
Lv, Kuan [3 ]
Ma, Guolin [3 ]
Lei, Baiying [1 ]
机构
[1] Shenzhen Univ, Hlth Sci Ctr, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Shenzhen 518060, Peoples R China
[2] Heping Hospl, Affiliated Changzhi Med Col, Dept Med Imaging, 10 0 038, Changzhi 100038, Peoples R China
[3] China Japan Friendship Hosp, Dept Radiol, 10 0 029, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Lymph node metastasis; Multi-source domain adaptation; Feature pyramid network; Domain selection; Graph convolutional network; SEGMENTATION; CLASSIFICATION; ADAPTATION; CT;
D O I
10.1016/j.media.2022.102467
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Preoperative prediction of lymph node (LN) metastasis based on computed tomography (CT) scans is an important task in gastric cancer, but few machine learning-based techniques have been proposed. While multi-center datasets increase sample size and representation ability, they suffer from inter-center heterogeneity. To tackle the above issue, we propose a novel multi-source domain adaptation framework for this diagnosis task, which not only considers domain-invariant and domain-specific features, but also achieves the imbalanced knowledge transfer and class-aware feature alignment across domains. First, we develop a 3D improved feature pyramidal network (i.e., 3D IFPN) to extract common multi-level features from the high-resolution 3D CT images, where a feature dynamic transfer (FDT) module can promote the network's ability to recognize the small target (i.e., LN). Then, we design an unsupervised domain selective graph convolutional network (i.e., UDS-GCN), which mainly includes three types of components: domain-specific feature extractor, domain selector and class-aware GCN classifier. Specifically, multiple domain-specific feature extractors are employed for learning domain-specific features from the common multi-level features generated by the 3D IFPN. A domain selector via the optimal transport (OT) theory is designed for controlling the amount of knowledge transferred from source domains to the target domain. A class-aware GCN classifier is developed to explicitly enhance/weaken the intra-class/inter-class similarity of all sample pairs across domains. To optimize UDS-GCN, the domain selector and the class-aware GCN classifier provide reliable target pseudo-labels to each other in the iterative process by collaborative learning. The extensive experiments are conducted on an in-house CT image dataset collected from four medical centers to demonstrate the efficacy of our proposed method. Experimental results verify that the proposed method boosts LN metastasis diagnosis performance and outperforms state-of-the-art methods. Our code is publically available at https://github.com/infinite-tao/LN _ MSDA .(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 54 条
  • [1] A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI
    Avendi, M. R.
    Kheradvar, Arash
    Jafarkhani, Hamid
    [J]. MEDICAL IMAGE ANALYSIS, 2016, 30 : 108 - 119
  • [2] Baktashmotlagh M, 2016, J MACH LEARN RES, V17
  • [3] Dynamic Region-Aware Convolution
    Chen, Jin
    Wang, Xijun
    Guo, Zichao
    Zhang, Xiangyu
    Sun, Jian
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8060 - 8069
  • [4] Optimal Transport for Domain Adaptation
    Courty, Nicolas
    Flamary, Remi
    Tuia, Devis
    Rakotomamonjy, Alain
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (09) : 1853 - 1865
  • [5] Cuturi M., 2013, Advances in Neural Information Processing Systems, V26, P2292
  • [6] DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptation
    Damodaran, Bharath Bhushan
    Kellenberger, Benjamin
    Flamary, Remi
    Tuia, Devis
    Courty, Nicolas
    [J]. COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 : 467 - 483
  • [7] An Intelligent Clinical Decision Support System for Preoperative Prediction of Lymph Node Metastasis in Gastric Cancer
    Feng, Qiu-Xia
    Liu, Chang
    Qi, Liang
    Sun, Shu-Wen
    Song, Yang
    Yang, Guang
    Zhang, Yu-Dong
    Liu, Xi-Sheng
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2019, 16 (07) : 952 - 960
  • [8] Ganin Y, 2016, J MACH LEARN RES, V17
  • [9] CE-Net: Context Encoder Network for 2D Medical Image Segmentation
    Gu, Zaiwang
    Cheng, Jun
    Fu, Huazhu
    Zhou, Kang
    Hao, Huaying
    Zhao, Yitian
    Zhang, Tianyang
    Gao, Shenghua
    Liu, Jiang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) : 2281 - 2292
  • [10] The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 challenge
    Heller, Nicholas
    Isensee, Fabian
    Maier-Hein, Klaus H.
    Hou, Xiaoshuai
    Xie, Chunmei
    Li, Fengyi
    Nan, Yang
    Mu, Guangrui
    Lin, Zhiyong
    Han, Miofei
    Yao, Guang
    Gao, Yaozong
    Zhang, Yao
    Wang, Yixin
    Hou, Feng
    Yang, Jiawei
    Xiong, Guangwei
    Tian, Jiang
    Zhong, Cheng
    Ma, Jun
    Rickman, Jack
    Dean, Joshua
    Stai, Bethany
    Tejpaul, Resha
    Oestreich, Makinna
    Blake, Paul
    Kaluzniak, Heather
    Raza, Shaneabbas
    Rosenberg, Joel
    Moore, Keenan
    Walczak, Edward
    Rengel, Zachary
    Edgerton, Zach
    Vasdev, Ranveer
    Peterson, Matthew
    McSweeney, Sean
    Peterson, Sarah
    Kalapara, Arveen
    Sathianathen, Niranjan
    Papanikolopoulos, Nikolaos
    Weight, Christopher
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 67