Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

被引:38
作者
Han, R. [1 ]
Jones, C. K. [2 ]
Lee, J. [3 ]
Wu, P. [1 ]
Vagdargi, P. [4 ]
Uneri, A. [1 ]
Helm, P. A. [5 ]
Luciano, M. [6 ]
Anderson, W. S. [6 ]
Siewerdsen, J. H. [1 ,2 ,4 ,6 ]
机构
[1] Johns Hopkins Univ, Dept Biomed Engn, Baltimore, MD 21205 USA
[2] Johns Hopkins Univ, Malone Ctr Engn Healthcare, Baltimore, MD USA
[3] Johns Hopkins Univ, Dept Radiat Oncol, Baltimore, MD USA
[4] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
[5] Medtronic Inc, Littleton, MA USA
[6] Johns Hopkins Univ Hosp, Dept Neurosurg, Baltimore, MD USA
关键词
Deformable registration; Unsupervised learning; Image synthesis; Inter-modality registration; LEARNING FRAMEWORK;
D O I
10.1016/j.media.2021.102292
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Purpose: The accuracy of minimally invasive, intracranial neurosurgery can be challenged by deformation of brain tissue - e.g., up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach. We report an unsupervised, deep learning-based registration framework to resolve such deformations between preoperative MR and intraoperative CT with fast runtime for neurosurgical guidance. Method: The framework incorporates subnetworks for MR and CT image synthesis with a dual-channel registration subnetwork (with synthesis uncertainty providing spatially varying weights on the dual-channel loss) to estimate a diffeomorphic deformation field from both the MR and CT channels. An end-to-end training is proposed that jointly optimizes both the synthesis and registration subnetworks. The proposed framework was investigated using three datasets: (1) paired MR/CT with simulated deformations; (2) paired MR/CT with real deformations; and (3) a neurosurgery dataset with real deformation. Two state-of-the-art methods (Symmetric Normalization and VoxelMorph) were implemented as a basis of comparison, and variations in the proposed dual-channel network were investigated, including single-channel registration, fusion without uncertainty weighting, and conventional sequential training of the synthesis and registration subnetworks. Results: The proposed method achieved: (1) Dice coefficient = 0.82 +/- 0.07 and TRE = 1.2 +/- 0.6 mm on paired MR/CT with simulated deformations; (2) Dice coefficient = 0.83 +/- 0.07 and TRE = 1.4 +/- 0.7 mm on paired MR/CT with real deformations; and (3) Dice = 0.79 +/- 0.13 and TRE = 1.6 +/- 1.0 mm on the neurosurgery dataset with real deformations. The dual-channel registration with uncertainty weighting demonstrated superior performance (e.g., TRE = 1.2 +/- 0.6 mm) compared to single-channel registration (TRE = 1.6 +/- 1.0 mm, p < 0.05 for CT channel and TRE = 1.3 +/- 0.7 mm for MR channel) and dual channel registration without uncertainty weighting (TRE = 1.4 +/- 0.8 mm, p < 0.05). End-to-end training of the synthesis and registration subnetworks also improved performance compared to the conventional sequential training strategy (TRE = 1.3 +/- 0.6 mm). Registration runtime with the proposed network was similar to 3 s. Conclusion: The deformable registration framework based on dual-channel MR/CT registration with spatially varying weights and end-to-end training achieved geometric accuracy and runtime that was superior to state-of-the-art baseline methods and various ablations of the proposed network. The accuracy and runtime of the method may be compatible with the requirements of high-precision neurosurgery. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:19
相关论文
共 56 条
  • [1] [Anonymous], 2014, P 2 INT C LEARN REPR
  • [2] Arsigny V, 2006, LECT NOTES COMPUT SC, V4190, P924
  • [3] Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain
    Avants, B. B.
    Epstein, C. L.
    Grossman, M.
    Gee, J. C.
    [J]. MEDICAL IMAGE ANALYSIS, 2008, 12 (01) : 26 - 41
  • [4] VoxelMorph: A Learning Framework for Deformable Medical Image Registration
    Balakrishnan, Guha
    Zhao, Amy
    Sabuncu, Mert R.
    Guttag, John
    Dalca, Adrian, V
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) : 1788 - 1800
  • [5] Multimodal 3D medical image registration guided by shape encoder-decoder networks
    Blendowski, Max
    Bouteldja, Nassim
    Heinrich, Mattias P.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2020, 15 (02) : 269 - 276
  • [6] Deep Learning Based Inter-modality Image Registration Supervised by Intra-modality Similarity
    Cao, Xiaohuan
    Yang, Jianhuan
    Wang, Li
    Xue, Zhong
    Wang, Qian
    Shen, Dinggang
    [J]. MACHINE LEARNING IN MEDICAL IMAGING: 9TH INTERNATIONAL WORKSHOP, MLMI 2018, 2018, 11046 : 55 - 63
  • [7] Deformable Image Registration Using a Cue-Aware Deep Regression Network
    Cao, Xiaohuan
    Yang, Jianhua
    Zhang, Jun
    Wang, Qian
    Yap, Pew-Thian
    Shen, Dinggang
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (09) : 1900 - 1911
  • [8] Deep Group-Wise Registration for Multi-Spectral Images From Fundus images
    Che, Tongtong
    Zheng, Yuanjie
    Cong, Jinyu
    Jiang, Yanyun
    Niu, Yi
    Jiao, Wanzhen
    Zhao, Bojun
    Ding, Yanhui
    [J]. IEEE ACCESS, 2019, 7 : 27650 - 27661
  • [9] Cross contrast multi-channel image registration using image synthesis for MR brain images
    Chen, Min
    Carass, Aaron
    Jog, Amod
    Lee, Junghoon
    Roy, Snehashis
    Prince, Jerry L.
    [J]. MEDICAL IMAGE ANALYSIS, 2017, 36 : 2 - 14
  • [10] Chen Z, 2018, PR MACH LEARN RES, V80