Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty

被引:49
作者
De Nigris, Dante [1 ]
Collins, D. Louis [2 ]
Arbel, Tal [1 ]
机构
[1] McGill Univ, Ctr Intelligent Machines, Montreal, PQ H3A 0E9, Canada
[2] McGill Univ, Montreal Neurol Inst, Montreal, PQ H3A 2B4, Canada
基金
加拿大健康研究院; 加拿大自然科学与工程研究理事会;
关键词
Magnetic resonance imaging (MRI); multi-modal; multi-scale; neurosurgery; registration; ultrasound; MUTUAL-INFORMATION; RIGID REGISTRATION; ULTRASOUND;
D O I
10.1109/TMI.2012.2218116
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose a new multi-scale technique for multi-modal image registration based on the alignment of selected gradient orientations of reduced uncertainty. We show how the registration robustness and accuracy can be improved by restricting the evaluation of gradient orientation alignment to locations where the uncertainty of fixed image gradient orientations is minimal, which we formally demonstrate correspond to locations of high gradient magnitude. We also embed a computationally efficient technique for estimating the gradient orientations of the transformed moving image (rather than resampling pixel intensities and recomputing image gradients). We have applied our method to different rigid multi-modal registration contexts. Our approach outperforms mutual information and other competing metrics in the context of rigid multi-modal brain registration, where we show sub-millimeter accuracy with cases obtained from the retrospective image registration evaluation project. Furthermore, our approach shows significant improvements over standard methods in the highly challenging clinical context of image guided neurosurgery, where we demonstrate misregistration of less than 2 mm with relation to expert selected landmarks for the registration of pre-operative brain magnetic resonance images to intra-operative ultrasound images.
引用
收藏
页码:2343 / 2354
页数:12
相关论文
共 50 条
[21]   MULTI-MODAL IMAGE REGISTRATION USING FUZZY KERNEL REGRESSION [J].
Ardizzone, Edoardo ;
Gallea, Roberto ;
Gambino, Orazio ;
Pirrone, Roberto .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :193-196
[22]   A multi-resolution area-based technique for automatic multi-modal image registration [J].
Bunting, Peter ;
Labrosse, Frederic ;
Lucas, Richard .
IMAGE AND VISION COMPUTING, 2010, 28 (08) :1203-1219
[23]   Multi-modal Remote Sensing Image Registration Based on Multi-scale Phase Congruency [J].
Cui, Song ;
Zhong, Yanfei .
2018 10TH IAPR WORKSHOP ON PATTERN RECOGNITION IN REMOTE SENSING (PRRS), 2018,
[24]   Robust Multi-Modal Image Registration for Image Fusion Enhancement in Infrastructure Inspection [J].
Shahsavarani, Sara ;
Lopez, Fernando ;
Ibarra-Castanedo, Clemente ;
Maldague, Xavier P. V. .
SENSORS, 2024, 24 (12)
[25]   Accelerating multi-modal image registration using a supervoxel-based variational framework [J].
Lafitte, L. ;
Zachiu, C. ;
Kerkmeijer, L. G. W. ;
Ries, M. ;
de Senneville, B. Denis .
PHYSICS IN MEDICINE AND BIOLOGY, 2018, 63 (23)
[26]   A New Multi-Modal Similarity Measure for Fast Gradient-Based 2D-3D Image Registration [J].
Pickering, Mark R. ;
Muhit, Abdullah A. ;
Searvell, Jennie M. ;
Smith, Paul N. .
2009 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-20, 2009, :5821-+
[27]   DEFORMABLE MULTI-MODAL IMAGE REGISTRATION BY MAXIMIZING ReNYI'S STATISTICAL DEPENDENCE MEASURE [J].
Chen, Yunmei ;
Shi, Jiangli ;
Rao, Murali ;
Lee, Jin-Seop .
INVERSE PROBLEMS AND IMAGING, 2015, 9 (01) :79-103
[28]   Multi-modal and Multi-spectral Registration for Natural Images [J].
Shen, Xiaoyong ;
Xu, Li ;
Zhang, Qi ;
Jia, Jiaya .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :309-324
[29]   IDCF: information distribution composite feature for multi-modal image registration [J].
Yan, Xutao ;
Shi, Zhen ;
Li, Pei ;
Zhang, Yuefa .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (06) :1939-1975
[30]   MULTI-MODAL IMAGE REGISTRATION USING LINE FEATURES AND MUTUAL INFORMATION [J].
Zouqi, Mehrnaz ;
Samarabandu, Jagath ;
Zhou, Yanbo .
2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, :129-132