Context-aware network fusing transformer and V-Net for semi-supervised segmentation of 3D left atrium

被引:49
作者
Zhao, Chenji [1 ]
Xiang, Shun [1 ]
Wang, Yuanquan [1 ]
Cai, Zhaoxi [2 ]
Shen, Jun [2 ]
Zhou, Shoujun [3 ]
Zhao, Di [4 ]
Su, Weihua [1 ]
Guo, Shijie [1 ,5 ]
Li, Shuo [6 ]
机构
[1] Hebei Univ Technol HeBUT, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
[2] Sun Yat Sen Univ, Sun Yat Sen Mem Hosp, Dept Radiol, Guangzhou 510120, Peoples R China
[3] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen 518055, Peoples R China
[4] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[5] HeBUT, Hebei Key Lab Robot Percept & Human Robot Interact, Tianjin 300401, Peoples R China
[6] Western Univ, Dept Med Imaging, DIG London, London, ON N6A 4V2, Canada
基金
美国国家科学基金会;
关键词
3D MRI; Contextual information; Image segmentation; Semi -supervised learning; Transformers;
D O I
10.1016/j.eswa.2022.119105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate, robust and automatic segmentation of the left atrium (LA) in magnetic resonance images (MRI) is of great significance for studying the LA structure and facilitating the diagnosis and treatment of atrial fibrillation. Semi-supervised learning has attracted great attention in medical image segmentation, since it alleviates the heavy burden of annotating training data. In this paper, we propose a context-aware network called CA-Net for semi-supervised LA segmentation from 3D MRI. The information of 3D MRI to be learned is not only the contextual information in each slice, but also the spatial information among different slices of the data, which is not sufficiently exploit by existing methods. In the proposed CA-Net, a Trans-V module is coined from both Transformers and V-Net, which is able to learn contextual information in 3D MRI. In the training processing, the discriminator with attention mechanisms is introduced to calculate an adversarial loss so that a large amount of unlabeled data can be utilized. Experimental results on the Atrial Segmentation Challenge dataset show that the contextual information is helpful to extract more accurate atrial structures, and the proposed CA-Net achieves better performance than some SOTA semi-supervised networks. Our method achieves dice scores of 88.14% and 90.09% in segmentation results when trained with 10% and 20% of labeled data, respectively. Code will be available at: https://github.com/RhythmI/CA-Net-master.
引用
收藏
页数:9
相关论文
共 38 条
  • [1] [Anonymous], 2020, ARXIV
  • [2] Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations
    Bortsova, Gerda
    Dubost, Florian
    Hogeweg, Laurens
    Katramados, Ioannis
    de Bruijne, Marleen
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 810 - 818
  • [3] Chen Chen, 2019, Statistical Atlases and Computational Models of the Heart. Atrial Segmentation and LV Quantification Challenges. 9th International Workshop, STACOM 2018. Held in Conjunction with MICCAI 2018. Revised Selected Papers: Lecture Notes in Computer Science (LNCS 11395), P292, DOI 10.1007/978-3-030-12029-0_32
  • [4] Chen J, 2021, arXiv
  • [5] Hansen Brian J, 2017, JACC Clin Electrophysiol, V3, P531, DOI 10.1016/j.jacep.2017.05.002
  • [6] The Spatial Distribution of Late Gadolinium Enhancement of Left Atrial Magnetic Resonance Imaging in Patients With Atrial Fibrillation
    Higuchi, Koji
    Cates, Joshua
    Gardner, Gregory
    Morris, Alan
    Burgon, Nathan S.
    Akoum, Nazem
    Marrouche, Nassir F.
    [J]. JACC-CLINICAL ELECTROPHYSIOLOGY, 2018, 4 (01) : 49 - 58
  • [7] Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
  • [8] Hung W.C., 2018, ARXIV180207934, P65
  • [9] Kingma DP., 2014, ARXIV, DOI DOI 10.48550/ARXIV.1412.6980
  • [10] Lei Li, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12264), P118, DOI 10.1007/978-3-030-59719-1_12