Multi-Modal Image Registration Based on Gradient Orientations of Minimal Uncertainty

被引:49
作者
De Nigris, Dante [1 ]
Collins, D. Louis [2 ]
Arbel, Tal [1 ]
机构
[1] McGill Univ, Ctr Intelligent Machines, Montreal, PQ H3A 0E9, Canada
[2] McGill Univ, Montreal Neurol Inst, Montreal, PQ H3A 2B4, Canada
基金
加拿大健康研究院; 加拿大自然科学与工程研究理事会;
关键词
Magnetic resonance imaging (MRI); multi-modal; multi-scale; neurosurgery; registration; ultrasound; MUTUAL-INFORMATION; RIGID REGISTRATION; ULTRASOUND;
D O I
10.1109/TMI.2012.2218116
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper, we propose a new multi-scale technique for multi-modal image registration based on the alignment of selected gradient orientations of reduced uncertainty. We show how the registration robustness and accuracy can be improved by restricting the evaluation of gradient orientation alignment to locations where the uncertainty of fixed image gradient orientations is minimal, which we formally demonstrate correspond to locations of high gradient magnitude. We also embed a computationally efficient technique for estimating the gradient orientations of the transformed moving image (rather than resampling pixel intensities and recomputing image gradients). We have applied our method to different rigid multi-modal registration contexts. Our approach outperforms mutual information and other competing metrics in the context of rigid multi-modal brain registration, where we show sub-millimeter accuracy with cases obtained from the retrospective image registration evaluation project. Furthermore, our approach shows significant improvements over standard methods in the highly challenging clinical context of image guided neurosurgery, where we demonstrate misregistration of less than 2 mm with relation to expert selected landmarks for the registration of pre-operative brain magnetic resonance images to intra-operative ultrasound images.
引用
收藏
页码:2343 / 2354
页数:12
相关论文
共 50 条
[41]   Multi-modal Brain MR Image Registration using A Novel Local Binary Descriptor based on Statistical Approach [J].
Borvornvitchotikarn, Thuvanan .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) :264-269
[42]   A curvelet-based patient-specific prior for accurate multi-modal brain image rigid registration [J].
Freiman, M. ;
Werman, M. ;
Joskowicz, L. .
MEDICAL IMAGE ANALYSIS, 2011, 15 (01) :125-132
[43]   Multi-Modal Fake News Detection Based on Image Captions [J].
Gu, Yadong ;
Hamdulla, Askar ;
Ablimit, Mijit .
2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
[44]   Multi-modal brain tumor image segmentation based on SDAE [J].
Ding, Yi ;
Dong, Rongfeng ;
Lan, Tian ;
Li, Xuerui ;
Shen, Guangyu ;
Chen, Hao ;
Qin, Zhiguang .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2018, 28 (01) :38-47
[45]   Multi-modal Registration Using a Combined Similarity Measure [J].
Wachs, Juan ;
Stern, Helman ;
Burks, Tom ;
Alchanatis, Victor .
APPLICATIONS OF SOFT COMPUTING: UPDATING THE STATE OF THE ART, 2009, 52 :159-+
[46]   Non-rigid multi-modal registration on the GPU [J].
Vetter, Christoph ;
Guetter, Christoph ;
Xu, Chenyang ;
Westermann, Rudiger .
MEDICAL IMAGING 2007: IMAGE PROCESSING, PTS 1-3, 2007, 6512
[47]   Multi-modal Registration of SAR and Optical Satellite Images [J].
Hasan, Mahmudul ;
Pickering, Mark R. ;
Jia, Xiuping .
2009 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2009), 2009, :447-453
[48]   Deformable multi-modal registration using 3D-FAST conditioned mutual information [J].
Liu, Xueli ;
Tang, Zhixian ;
Wang, Manning ;
Song, Zhijian .
COMPUTER ASSISTED SURGERY, 2017, 22 :295-304
[49]   Edge-Based Multi-modal Registration and Application for Night Vision Devices [J].
Sutour, Camille ;
Aujol, Jean-Francois ;
Deledalle, Charles-Alban ;
de Senneville, Baudouin Denis .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2015, 53 (02) :131-150
[50]   Modeling breast biomechanics for multi-modal image analysis-successes and challenges [J].
Rajagopal, Vijay ;
Nielsen, Poul M. F. ;
Nash, Martyn P. .
WILEY INTERDISCIPLINARY REVIEWS-SYSTEMS BIOLOGY AND MEDICINE, 2010, 2 (03) :293-304