Performance evaluation of state-of-the-art multimodal remote sensing image matching methods in the presence of noise

被引:3
作者
Jovhari, Negar [1 ]
Sedaghat, Amin [1 ]
Mohammadi, Nazila [1 ]
Farhadi, Nima [2 ]
Mahtaj, Alireza Bahrami [2 ]
机构
[1] Univ Tabriz, Dept Geomat Engn, Tabriz, Iran
[2] KN Toosi Univ Technol, Dept Geomat & Remote Sensing, Tehran, Iran
关键词
Multimodal images; Noise; Automatic image matching; MKD descriptor; Learning-based descriptor; Uniform competency; SELF-SIMILARITY DESCRIPTOR; REGISTRATION; SIFT; SAR;
D O I
10.1007/s12518-024-00553-y
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
To date, various image registration approaches have been conducted to deal with distortions between multimodal image pairs. However, significant existing noise as an unavoidable issue deteriorates many conventional and advanced methods. The critical key is to choose a highly robust local feature detection and description method as the principle for many matching frameworks. However, few studies have concentrated on dealing with the noise issue. For this purpose, this paper evaluates the most well-known and state-of-the-art feature descriptors against artificial sequential noise levels. The employed methods consist of various handcrafted learning-based descriptors. It is further indicated that in addition to the designed structural feature map, multiple criteria, such as spatial arrangement, and the magnitude of the support area, play roles in achieving successful matching, especially in the presence of dramatic noise and complex distortion between multimodal images. Moreover, to filter out the noisy features, the employed local feature detectors are integrated with the uniform competency algorithm. Experimental results demonstrate the overall superiority (20.0% on average) of the MKD (multiple-kernel descriptor) due to advanced designed integrated kernels and polar arrangements.
引用
收藏
页码:215 / 233
页数:19
相关论文
共 79 条
[1]  
Balntas V., 2016, LEARNING LOCAL FEATU, DOI DOI 10.5244/C.30.119
[2]   Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters [J].
Barroso-Laguna, Axel ;
Riba, Edgar ;
Ponsa, Daniel ;
Mikolajczyk, Krystian .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :5835-5843
[3]  
Bartoli A, 2012, 12 EUR C COMP VIS FL
[4]  
Belongie S, 2001, ADV NEUR IN, V13, P831
[5]   Reinforced Feature Points: Optimizing Feature Detection and Description for a High-Level Task [J].
Bhowmik, Aritra ;
Gumhold, Stefan ;
Rother, Carsten ;
Brachmann, Eric .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4947-4956
[6]   Remote Sensing Image Registration Based on Modified SIFT and Feature Slope Grouping [J].
Chang, Herng-Hua ;
Wu, Guan-Long ;
Chiang, Mao-Hsiung .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (09) :1363-1367
[7]   A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration [J].
Chen, Jian ;
Tian, Jie ;
Lee, Noah ;
Zheng, Jian ;
Smith, R. Theodore ;
Laine, Andrew F. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (07) :1707-1718
[8]   length Shape-Former: Bridging CNN and Transformer via ShapeConv for multimodal image matching [J].
Chen, Jiaxuan ;
Chen, Xiaoxian ;
Chen, Shuang ;
Liu, Yuyan ;
Rao, Yujing ;
Yang, Yang ;
Wang, Haifeng ;
Wu, Dan .
INFORMATION FUSION, 2023, 91 :445-457
[9]   Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration [J].
Cui, Song ;
Xu, Miaozhong ;
Ma, Ailong ;
Zhong, Yanfei .
REMOTE SENSING, 2020, 12 (18)
[10]  
DEOLIVEIRA EM, 2023, APPL GEOMAT, P1