A CNN-TRANSFORMER HYBRID FEATURE DESCRIPTOR FOR OPTICAL-SAR IMAGE REGISTRATION

被引:0
作者
Lin, Mingxin [1 ]
Liu, Binyuan [1 ]
Liu, Yijun [1 ]
Wang, Qingsong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Commun Engn, Guangzhou, Peoples R China
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
基金
美国国家科学基金会;
关键词
optical-SAR image registration; feature descriptor; CNN; Transformer;
D O I
10.1109/IGARSS52108.2023.10281985
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
This paper presents a CNN-Transformer hybrid feature descriptor for the registration of optical and SAR images. The proposed feature descriptor is composed of a shallow feature extraction module based on CNN and a deep feature extraction module based on Transformer, which are tailored to extract features from different levels. Its effectiveness is demonstrated in experiments with comparison to state-of-the-art methods. Experimental results demonstrated its superior performance compare to the state-of-the-art methods, thus showcasing its efficacy and potential for practical applications. Index
引用
收藏
页码:6069 / 6072
页数:4
相关论文
共 50 条
  • [1] CNN-Transformer Hybrid Architecture for Underwater Sonar Image Segmentation
    Lei, Juan
    Wang, Huigang
    Lei, Zelin
    Li, Jiayuan
    Rong, Shaowei
    REMOTE SENSING, 2025, 17 (04)
  • [2] Image enhancement with art design: a visual feature approach with a CNN-transformer fusion model
    Xu, Ming
    Cui, Jinwei
    Ma, Xiaoyu
    Zou, Zhiyi
    Xin, Zhisheng
    Bilal, Muhammad
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [3] HCTNet: A hybrid CNN-transformer network for breast ultrasound image segmentation
    He, Qiqi
    Yang, Qiuju
    Xie, Minghao
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 155
  • [4] A CNN-Transformer Hybrid Model Based on CSWin Transformer for UAV Image Object Detection
    Lu, Wanjie
    Lan, Chaozhen
    Niu, Chaoyang
    Liu, Wei
    Lyu, Liang
    Shi, Qunshan
    Wang, Shiju
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1211 - 1231
  • [5] CNN-TransNet: A Hybrid CNN-Transformer Network With Differential Feature Enhancement for Cloud Detection
    Ma, Nan
    Sun, Lin
    He, Yawen
    Zhou, Chenghu
    Dong, Chuanxiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [6] DACTransNet: A Hybrid CNN-Transformer Network for Histopathological Image Classification of Pancreatic Cancer
    Kou, Yongqing
    Xia, Cong
    Jiao, Yiping
    Zhang, Daoqiang
    Ge, Rongjun
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT II, 2024, 14474 : 422 - 434
  • [7] HTCNet: Hybrid Transformer-CNN for SAR Image Denoising
    Huang, Min
    Luo, Shuaili
    Wang, Shuaihui
    Guo, Jinghang
    Wang, Jingyang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 19380 - 19394
  • [8] HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation
    Zhang, Huaikun
    Lian, Jing
    Yi, Zetong
    Wu, Ruichao
    Lu, Xiangyu
    Ma, Pei
    Ma, Yide
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [9] Hybrid CNN-transformer network for efficient CSI feedback
    Zhao, Ruohan
    Liu, Ziang
    Song, Tianyu
    Jin, Jiyu
    Jin, Guiyue
    Fan, Lei
    PHYSICAL COMMUNICATION, 2024, 66
  • [10] Robust Image Forgery Localization Using Hybrid CNN-Transformer Synergy Based Framework
    Sharma, Sachin
    Singh, Brajesh Kumar
    Garg, Hitendra
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 4691 - 4708