A Multilevel Point-Matching Algorithm Based on Hierarchical Feature Detection and Description for SAR-to-Optical Image Registration

被引:0
作者
Lian, Zhixin [1 ]
Tang, Shiyang [1 ]
Han, Jiahao [1 ]
Wu, Yue [2 ]
Zhang, Mingjin [3 ,4 ,5 ]
Chen, Zhanye [6 ,7 ]
Zhang, Linrang [1 ]
机构
[1] Xidian Univ, Natl Key Lab Radar Signal Proc, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
[3] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[4] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian 710119, Peoples R China
[5] Sci & Technol Reliabil Phys & Applicat Technol Ele, Guangzhou 510610, Peoples R China
[6] Southeast Univ, State Key Lab Millimeter Waves, Nanjing 210096, Peoples R China
[7] Southeast Univ, Inst Electromagnet Space, Nanjing 210096, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Optical imaging; Image registration; Adaptive optics; Radar polarimetry; Accuracy; Feature detection; Optical filters; Phase change materials; Nonlinear optics; Feature description; feature detection; image registration; phase congruency (PC); synthetic aperture radar (SAR) to optical; SAMPLE CONSENSUS;
D O I
10.1109/JSTARS.2025.3546224
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
High-precision registration of synthetic aperture radar (SAR) and optical images based on point features remains a particularly challenging task, as the detection and description of feature points are susceptible to nonlinear radiometric distortions and SAR speckle noise. For this purpose, a multilevel point-matching algorithm based on hierarchical feature detection and description is proposed in this letter to improve the accuracy of SAR-to-optical (S-O) image registration. First, a FAST feature detector (OIPC-Fast) is constructed by combining overlapping chunking, image stratification, and phase congruency (PC). The OIPC-Fast detector performs hierarchical feature detection on SAR and optical images based on image properties by two-dimensional discrete wavelet transform and multimoment of PC map, respectively. Feature points with high consistency are screened out by voting criteria. The repeatability of keypoints is effectively improved. Then, a multilevel matching strategy is proposed. The SAR feature descriptor is constructed in this strategy by capturing more layers of image information rather than using a single denoised SAR image information after preprocessing, thus enhancing the robustness of SAR feature descriptors. Ten sets of real image data are used for experimental validation. Compared with some of the most advanced algorithms, the results indicate that the registration accuracy can be improved by applying the proposed point-matching algorithm to S-O image registration.
引用
收藏
页码:7318 / 7333
页数:16
相关论文
共 47 条
[31]   A Robust Algorithm Based on Phase Congruency for Optical and SAR Image Registration in Suburban Areas [J].
Wang, Lina ;
Sun, Mingchao ;
Liu, Jinghong ;
Cao, Lihua ;
Ma, Guoqing .
REMOTE SENSING, 2020, 12 (20) :1-27
[32]   3D Point Cloud Registration Algorithm Based on Feature Matching [J].
Liu Jian ;
Bai Di .
ACTA OPTICA SINICA, 2018, 38 (12)
[33]   SAR and Optical Image Registration Based on Uniform Feature Points Extraction and Consistency Gradient Calculation [J].
Zhang, Wannan ;
Zhao, Yuqian .
APPLIED SCIENCES-BASEL, 2023, 13 (03)
[34]   SAR-Optical Image Matching Using Self-Supervised Detection and a Transformer-CNN-Based Network [J].
Liu, Yijun ;
Lin, Mingxin ;
Mo, Yuanhui ;
Wang, Qingsong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
[35]   Research on image feature matching algorithm based on feature optical flow and corner feature [J].
Song, Tao ;
Chen, Bing ;
Zhao, Fu M. ;
Huang, Zheng ;
Huang, Mu J. .
JOURNAL OF ENGINEERING-JOE, 2020, 2020 (13) :529-534
[36]   Synthetic aperture radar image registration based on hybrid feature detection and multifeature constraint matching [J].
Pang, Bo ;
Yu, Qiuze ;
Sun, Hong ;
Xiao, Wenshuai ;
Xu, Yong ;
Zhang, Yan .
JOURNAL OF APPLIED REMOTE SENSING, 2018, 12 (03)
[37]   A novel image registration method for optical and SAR satellite images based on artificial immunity algorithm [J].
Feng, Tiantian ;
Ai, Cuifang ;
Wang, Jianmei ;
Zhang, Shaoming .
Tongji Daxue Xuebao/Journal of Tongji University, 2015, 43 (10) :1588-1593
[38]   A Rotation-Invariant Optical and SAR Image Registration Algorithm Based on Deep and Gaussian Features [J].
Li, Zeyi ;
Zhang, Haitao ;
Huang, Yihang .
REMOTE SENSING, 2021, 13 (13)
[39]   Neural network algorithm for optical-SAR image registration based on a uniform grid of points [J].
Volkov, V. V. ;
Shvets, E. A. .
COMPUTER OPTICS, 2024, 48 (04) :610-618
[40]   Feature Point Detection and Description Networks Based on Asymmetric Convolution and the Cross-ResolutionImage-Matching Method [J].
Zhang, Ruixing ;
Yao, Tao ;
Yan, Lianshan .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023