Robust and Fast Registration of Infrared and Visible Images for Electro-Optical Pod

被引:38
作者
Liu, Xiangzeng [1 ]
Ai, Yunfeng [2 ]
Tian, Bin [3 ]
Cao, Dongpu [4 ]
机构
[1] Xian Microelect Technol Inst, Xian 710065, Shaanxi, Peoples R China
[2] Univ Chinese Acad Sci, Artificial Intelligence Dept, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[4] Univ Waterloo, Dept Mech & Mechatron Engn, Waterloo, ON N2L 3G1, Canada
基金
中国国家自然科学基金;
关键词
Electro-optical pod; image registration; infrared and visible image; kernelized correlation filter; phase congruency; DESCRIPTOR; TRACKING;
D O I
10.1109/TIE.2018.2833051
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To deal with the registration of infrared and visible image with significant difference in contrast and large geometric distortion in electro-optical pod, a robust and fast registration method by using common structural features is proposed in this paper. First, to adjust the scales of input images, a geometric transformation model is built based on parameters of the cameras. Then, a global structural feature extraction strategy is developed by using phase congruency and significance ranking space. Those features are not only invariant to the scale and contrast but also embody the structural of the input images maximally and uniformly. Finally, to enhance the robustness to contrast, blurring, and incompleteness of structures, an adaptive feature matching method with kernelized correlation filter is presented. Experimental results demonstrate that the proposed method has better performance than several state-of-the-art methods in robustness and precision, and also confirm its validity in the real environment.
引用
收藏
页码:1335 / 1344
页数:10
相关论文
共 35 条
[1]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[2]   Thermal-visible registration of human silhouettes: A similarity measure performance evaluation [J].
Bilodeau, Guillaume-Alexandre ;
Torabi, Atousa ;
St-Charles, Pierre-Luc ;
Riahi, Dorra .
INFRARED PHYSICS & TECHNOLOGY, 2014, 64 :79-86
[3]  
Dawn S, 2010, LECT NOTES COMPUT SC, V6134, P103, DOI 10.1007/978-3-642-13681-8_13
[4]  
Donoser M., 2006, COMPUTER VISION PATT, DOI [10.1109/CVPR.2006.107, DOI 10.1109/CVPR.2006.107]
[5]   Multi-modal image registration using local frequency representation and computer-aided design (CAD) models [J].
Elbakary, M. I. ;
Sundareshan, M. K. .
IMAGE AND VISION COMPUTING, 2007, 25 (05) :663-670
[6]   Registration of Visible and Infrared Images Based on Gradient Information [J].
Geng, Yingnan ;
Wang, Yanan .
3D Research, 2017, 8 (02)
[7]   High-Speed Tracking with Kernelized Correlation Filters [J].
Henriques, Joao F. ;
Caseiro, Rui ;
Martins, Pedro ;
Batista, Jorge .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) :583-596
[8]  
Hossain MohammedAslam., 2012, DECELERATED DECLINE, P1
[9]   Drivable Road Reconstruction for Intelligent Vehicles Based on Two-View Geometry [J].
Jia, Bingxi ;
Chen, Jian ;
Zhang, Kaixiang .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2017, 64 (05) :3696-3706
[10]   DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation [J].
Kim, Seungryong ;
Min, Dongbo ;
Ham, Bumsub ;
Do, Minh N. ;
Sohn, Kwanghoon .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (09) :1712-1729