Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

被引:46
作者
Han, R. [1 ]
Jones, C. K. [2 ]
Lee, J. [3 ]
Wu, P. [1 ]
Vagdargi, P. [4 ]
Uneri, A. [1 ]
Helm, P. A. [5 ]
Luciano, M. [6 ]
Anderson, W. S. [6 ]
Siewerdsen, J. H. [1 ,2 ,4 ,6 ]
机构
[1] Johns Hopkins Univ, Dept Biomed Engn, Baltimore, MD 21205 USA
[2] Johns Hopkins Univ, Malone Ctr Engn Healthcare, Baltimore, MD USA
[3] Johns Hopkins Univ, Dept Radiat Oncol, Baltimore, MD USA
[4] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
[5] Medtronic Inc, Littleton, MA USA
[6] Johns Hopkins Univ Hosp, Dept Neurosurg, Baltimore, MD USA
关键词
Deformable registration; Unsupervised learning; Image synthesis; Inter-modality registration; LEARNING FRAMEWORK;
D O I
10.1016/j.media.2021.102292
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Purpose: The accuracy of minimally invasive, intracranial neurosurgery can be challenged by deformation of brain tissue - e.g., up to 10 mm due to egress of cerebrospinal fluid during neuroendoscopic approach. We report an unsupervised, deep learning-based registration framework to resolve such deformations between preoperative MR and intraoperative CT with fast runtime for neurosurgical guidance. Method: The framework incorporates subnetworks for MR and CT image synthesis with a dual-channel registration subnetwork (with synthesis uncertainty providing spatially varying weights on the dual-channel loss) to estimate a diffeomorphic deformation field from both the MR and CT channels. An end-to-end training is proposed that jointly optimizes both the synthesis and registration subnetworks. The proposed framework was investigated using three datasets: (1) paired MR/CT with simulated deformations; (2) paired MR/CT with real deformations; and (3) a neurosurgery dataset with real deformation. Two state-of-the-art methods (Symmetric Normalization and VoxelMorph) were implemented as a basis of comparison, and variations in the proposed dual-channel network were investigated, including single-channel registration, fusion without uncertainty weighting, and conventional sequential training of the synthesis and registration subnetworks. Results: The proposed method achieved: (1) Dice coefficient = 0.82 +/- 0.07 and TRE = 1.2 +/- 0.6 mm on paired MR/CT with simulated deformations; (2) Dice coefficient = 0.83 +/- 0.07 and TRE = 1.4 +/- 0.7 mm on paired MR/CT with real deformations; and (3) Dice = 0.79 +/- 0.13 and TRE = 1.6 +/- 1.0 mm on the neurosurgery dataset with real deformations. The dual-channel registration with uncertainty weighting demonstrated superior performance (e.g., TRE = 1.2 +/- 0.6 mm) compared to single-channel registration (TRE = 1.6 +/- 1.0 mm, p < 0.05 for CT channel and TRE = 1.3 +/- 0.7 mm for MR channel) and dual channel registration without uncertainty weighting (TRE = 1.4 +/- 0.8 mm, p < 0.05). End-to-end training of the synthesis and registration subnetworks also improved performance compared to the conventional sequential training strategy (TRE = 1.3 +/- 0.6 mm). Registration runtime with the proposed network was similar to 3 s. Conclusion: The deformable registration framework based on dual-channel MR/CT registration with spatially varying weights and end-to-end training achieved geometric accuracy and runtime that was superior to state-of-the-art baseline methods and various ablations of the proposed network. The accuracy and runtime of the method may be compatible with the requirements of high-precision neurosurgery. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:19
相关论文
共 56 条
[1]  
Arsigny V, 2006, LECT NOTES COMPUT SC, V4190, P924
[2]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[3]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[4]   Multimodal 3D medical image registration guided by shape encoder-decoder networks [J].
Blendowski, Max ;
Bouteldja, Nassim ;
Heinrich, Mattias P. .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2020, 15 (02) :269-276
[5]   Deep Learning Based Inter-modality Image Registration Supervised by Intra-modality Similarity [J].
Cao, Xiaohuan ;
Yang, Jianhuan ;
Wang, Li ;
Xue, Zhong ;
Wang, Qian ;
Shen, Dinggang .
MACHINE LEARNING IN MEDICAL IMAGING: 9TH INTERNATIONAL WORKSHOP, MLMI 2018, 2018, 11046 :55-63
[6]   Deformable Image Registration Using a Cue-Aware Deep Regression Network [J].
Cao, Xiaohuan ;
Yang, Jianhua ;
Zhang, Jun ;
Wang, Qian ;
Yap, Pew-Thian ;
Shen, Dinggang .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (09) :1900-1911
[7]   Deep Group-Wise Registration for Multi-Spectral Images From Fundus images [J].
Che, Tongtong ;
Zheng, Yuanjie ;
Cong, Jinyu ;
Jiang, Yanyun ;
Niu, Yi ;
Jiao, Wanzhen ;
Zhao, Bojun ;
Ding, Yanhui .
IEEE ACCESS, 2019, 7 :27650-27661
[8]   Cross contrast multi-channel image registration using image synthesis for MR brain images [J].
Chen, Min ;
Carass, Aaron ;
Jog, Amod ;
Lee, Junghoon ;
Roy, Snehashis ;
Prince, Jerry L. .
MEDICAL IMAGE ANALYSIS, 2017, 36 :2-14
[9]  
Chen Z, 2018, PR MACH LEARN RES, V80
[10]   Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration [J].
Dalca, Adrian V. ;
Balakrishnan, Guha ;
Guttag, John ;
Sabuncu, Mert R. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :729-738