Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty

被引:49
作者
De Nigris, Dante [1 ]
Collins, D. Louis [2 ]
Arbel, Tal [1 ]
机构
[1] McGill Univ, Ctr Intelligent Machines, Montreal, PQ H3A 0E9, Canada
[2] McGill Univ, Montreal Neurol Inst, Montreal, PQ H3A 2B4, Canada
基金
加拿大健康研究院; 加拿大自然科学与工程研究理事会;
关键词
Magnetic resonance imaging (MRI); multi-modal; multi-scale; neurosurgery; registration; ultrasound; MUTUAL-INFORMATION; RIGID REGISTRATION; ULTRASOUND;
D O I
10.1109/TMI.2012.2218116
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose a new multi-scale technique for multi-modal image registration based on the alignment of selected gradient orientations of reduced uncertainty. We show how the registration robustness and accuracy can be improved by restricting the evaluation of gradient orientation alignment to locations where the uncertainty of fixed image gradient orientations is minimal, which we formally demonstrate correspond to locations of high gradient magnitude. We also embed a computationally efficient technique for estimating the gradient orientations of the transformed moving image (rather than resampling pixel intensities and recomputing image gradients). We have applied our method to different rigid multi-modal registration contexts. Our approach outperforms mutual information and other competing metrics in the context of rigid multi-modal brain registration, where we show sub-millimeter accuracy with cases obtained from the retrospective image registration evaluation project. Furthermore, our approach shows significant improvements over standard methods in the highly challenging clinical context of image guided neurosurgery, where we demonstrate misregistration of less than 2 mm with relation to expert selected landmarks for the registration of pre-operative brain magnetic resonance images to intra-operative ultrasound images.
引用
收藏
页码:2343 / 2354
页数:12
相关论文
共 50 条
[31]   Non-rigid Multi-modal Medical Image Registration: A Review [J].
Xu, Tingting ;
Wei, Ning .
PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA TECHNOLOGY (ICMT-13), 2013, 84 :934-941
[32]   OP TIMIZED GPU HISTOGRAMS FOR MULTI-MODAL REGISTRATION [J].
Vetter, Christoph ;
Westermann, Ruediger .
2011 8TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2011, :1227-1230
[33]   Real-time multi-modal rigid registration based on a novel symmetric-SIFT descriptor [J].
Chen, Jian ;
Tian, Jie .
PROGRESS IN NATURAL SCIENCE-MATERIALS INTERNATIONAL, 2009, 19 (05) :643-651
[34]   EVolution: an edge-based variational method for non-rigid multi-modal image registration [J].
de Senneville, B. Denis ;
Zachiu, C. ;
Ries, M. ;
Moonen, C. .
PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (20) :7377-7396
[35]   Multi-modal medical image registration based on phase congruency and quantitative-qualitative mutual information [J].
Zhang, Shan ;
Han, Hongbin ;
Liu, Zhaoying ;
Liu, Bo ;
Zhou, Fugen .
MIPPR 2011: PARALLEL PROCESSING OF IMAGES AND OPTIMIZATION AND MEDICAL IMAGING PROCESSING, 2011, 8005
[36]   Multi-Modal Medical Image Registration with Full or Partial Data: A Manifold Learning Approach [J].
Bashiri, Fereshteh S. ;
Baghaie, Ahmadreza ;
Rostami, Reihaneh ;
Yu, Zeyun ;
D'Souza, Roshan M. .
JOURNAL OF IMAGING, 2019, 5 (01)
[38]   Applying stochastic second-order entropy images to multi-modal image registration [J].
Cun, Xiaodong ;
Pun, Chi-Man ;
Gao, Hao .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 65 :201-209
[39]   Multi-Modal Image Registration on the Basis of Local Structure Tensor-Mutual Information [J].
Zhang L. ;
Li B. ;
Tian L.-F. ;
Li X.-X. .
Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2017, 45 (07) :98-106
[40]   Multi-Modal Sensor Calibration Using a Gradient Orientation Measure [J].
Taylor, Zachary ;
Nieto, Juan ;
Johnson, David .
JOURNAL OF FIELD ROBOTICS, 2015, 32 (05) :675-695