A CNN-TRANSFORMER HYBRID FEATURE DESCRIPTOR FOR OPTICAL-SAR IMAGE REGISTRATION

被引:0
作者
Lin, Mingxin [1 ]
Liu, Binyuan [1 ]
Liu, Yijun [1 ]
Wang, Qingsong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Commun Engn, Guangzhou, Peoples R China
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
基金
美国国家科学基金会;
关键词
optical-SAR image registration; feature descriptor; CNN; Transformer;
D O I
10.1109/IGARSS52108.2023.10281985
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
This paper presents a CNN-Transformer hybrid feature descriptor for the registration of optical and SAR images. The proposed feature descriptor is composed of a shallow feature extraction module based on CNN and a deep feature extraction module based on Transformer, which are tailored to extract features from different levels. Its effectiveness is demonstrated in experiments with comparison to state-of-the-art methods. Experimental results demonstrated its superior performance compare to the state-of-the-art methods, thus showcasing its efficacy and potential for practical applications. Index
引用
收藏
页码:6069 / 6072
页数:4
相关论文
共 11 条
[1]   HarDNet: A Low Memory Traffic Network [J].
Chao, Ping ;
Kao, Chao-Yang ;
Ruan, Yu-Shan ;
Huang, Chien-Hsiang ;
Lin, Youn-Long .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3551-3560
[2]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395
[3]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[4]  
Huang M., 2021, ARXIV210308259
[5]   RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform [J].
Li, Jiayuan ;
Hu, Qingwu ;
Ai, Mingyao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3296-3310
[6]  
Lowe G., 2004, Int J, V2, P2
[7]   MobileNetV2: Inverted Residuals and Linear Bottlenecks [J].
Sandler, Mark ;
Howard, Andrew ;
Zhu, Menglong ;
Zhmoginov, Andrey ;
Chen, Liang-Chieh .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4510-4520
[8]   Bottleneck Transformers for Visual Recognition [J].
Srinivas, Aravind ;
Lin, Tsung-Yi ;
Parmar, Niki ;
Shlens, Jonathon ;
Abbeel, Pieter ;
Vaswani, Ashish .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :16514-16524
[9]  
Viswanathan D.G., 2009, P 10 WORKSH IM AN MU, P6
[10]   CSPNet: A New Backbone that can Enhance Learning Capability of CNN [J].
Wang, Chien-Yao ;
Liao, Hong-Yuan Mark ;
Wu, Yueh-Hua ;
Chen, Ping-Yang ;
Hsieh, Jun-Wei ;
Yeh, I-Hau .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1571-1580