Real-Time Stitching Algorithm of Vehicle Side View Image Based on Multi-Region Fast Phase Correlation

被引:1
作者
Xu, Mubin [1 ]
Liu, Xiaoyong [1 ]
Wan, Chuanhai [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Automat Sci & Engn, Xian 710049, Peoples R China
关键词
Image registration; image stitching; phase correlation; road vehicles; vehicle detection; QUALITY ASSESSMENT; REGISTRATION; EXTENSION;
D O I
10.1109/ACCESS.2024.3525181
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the problem that the camera field of view is too small to obtain the complete side image of the vehicle in the traffic management scene, a real-time stitching algorithm of vehicle side view image based on Multi-Region Fast Phase Correlation (MFPC) is proposed. Firstly, the background subtraction method based on Gaussian mixture model is used to obtain vehicle foreground image sequence, and the image is downsampled by Gaussian pyramid to reduce the running time of the program. Subsequently, multi-region phase correlation and registration check based on normalized cross-correlation are used to improve the accuracy of registration, and a local inverse discrete Fourier transform method is proposed to improve the computational efficiency. To mitigate background interference in registration, a peak filtering algorithm is proposed, combined with a sub-pixel refinement algorithm to enhance accuracy. Experimental results indicate that the proposed algorithm has better registration performance than the traditional phase correlation and methods based on feature point detection. It requires only 26% of the time taken by the traditional phase correlation, with an average processing time per frame of 3.81 ms, which meets the real-time requirements. In practical applications, the stitching accuracy reached 99.33%, demonstrating high precision and robustness.
引用
收藏
页码:5076 / 5091
页数:16
相关论文
共 38 条
[1]   Robust Image Stitching and Reconstruction of Rolling Stocks Using a Novel Kalman Filter With a Multiple-Hypothesis Measurement Model [J].
Avizzano, Carlo Alberto ;
Scivoletto, Gabriele ;
Tripicchio, Paolo .
IEEE ACCESS, 2021, 9 :154011-154021
[2]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[3]   A sliding template-based approach for position-based whole slide microscopy image stitching for slightly unaligned stages [J].
Bhadouria, Vikesh Singh ;
Park, You-rim ;
Eom, Joo Beom .
SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) :2597-2605
[4]  
CHEN QS, 1994, IEEE T PATTERN ANAL, V16, P1156
[5]   A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges [J].
El Saer, Andreas ;
Grammatikopoulos, Lazaros ;
Sfikas, Giorgos ;
Karras, George ;
Petsa, Elli .
SENSORS, 2024, 24 (04)
[6]   Extension of phase correlation to subpixel registration [J].
Foroosh, H ;
Zerubia, JB ;
Berthod, M .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2002, 11 (03) :188-200
[7]   Automated Coregistration of Multisensor Orthophotos Generated from Unmanned Aerial Vehicle Platforms [J].
Han, Youkyung ;
Choi, Jaewan ;
Jung, Jinha ;
Chang, Anjin ;
Oh, Sungchan ;
Yeom, Junho .
JOURNAL OF SENSORS, 2019, 2019
[8]   A subspace identification extension to the phase correlation method [J].
Hoge, WS .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2003, 22 (02) :277-280
[9]  
Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
[10]   Iterative Phase Correlation Algorithm for High-precision Subpixel Image Registration [J].
Hrazdira, Zdenek ;
Druckmueller, Miloslav ;
Habbal, Shadia .
ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2020, 247 (01)