SCENE-LEVEL MATCHING BETWEEN REMOTE SENSING OPTICAL AND SAR IMAGES

被引:0
作者
Zhong, Haiyang [1 ,2 ]
Yan, Yiming [1 ,2 ]
Gu, Guihua [3 ]
Su, Nan [1 ,2 ]
Zhang, Hongzhe [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin, Peoples R China
[2] Key Lab Adv Marine Commun & Informat Technol, Harbin, Peoples R China
[3] Shanghai Inst Satellite Engn, Shanghai, Peoples R China
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
基金
中国国家自然科学基金;
关键词
SAR Image; Multi-Modal Image; Pseudo-Siamese Network; Part-Level Feature; Information Bottleneck;
D O I
10.1109/IGARSS52108.2023.10281652
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Due to the relative complementarity between optical images and Synthetic Aperture Radar (SAR) images, the method of SAR-optical matching is widely used in auxiliary navigation, disaster monitoring, rescue and other fields. However, there are huge geometric and radiometric differences between SAR and optical images, which pose serious challenges for multimodal image matching. To solve this problem, this paper proposes a Refined Subdivision Processing Network (RSPNet) for SAR-optical matching. Firstly, to extract representative features of images, we propose to employ the pseudo-Siamese network structure with dual-branch partial weight sharing in RSPNet. Then, to preserve the detailed information in the image, the method of subdividing the features to generate part-level features of the image is proposed. Finally, to remove modality-specific but task-independent information, part-level features are refined using information bottleneck methods. Experiments show that our proposed method has an excellent performance in the Scene-level matching between optical and SAR images.
引用
收藏
页码:616 / 619
页数:4
相关论文
共 14 条
[1]   SAR-SIFT: A SIFT-LIKE ALGORITHM FOR APPLICATIONS ON SAR IMAGES [J].
Dellinger, Flora ;
Delon, Julie ;
Gousseau, Yann ;
Michel, Julien ;
Tupin, Florence .
2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, :3478-3481
[2]  
Huang M., 2021, arXiv
[3]   Identifying Corresponding Patches in SAR and Optical Images With a Pseudo-Siamese CNN [J].
Hughes, Lloyd H. ;
Schmitt, Michael ;
Mou, Lichao ;
Wang, Yuanyuan ;
Zhu, Xiao Xiang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (05) :784-788
[4]   A deep learning framework for matching of SAR and optical imagery [J].
Hughes, Lloyd Haydn ;
Marcos, Diego ;
Lobry, Sylvain ;
Tuia, Devis ;
Schmitt, Michael .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 169 :166-179
[5]   Mining Hard Negative Samples for SAR-Optical Image Matching Using Generative Adversarial Networks [J].
Hughes, Lloyd Haydn ;
Schmitt, Michael ;
Zhu, Xiao Xiang .
REMOTE SENSING, 2018, 10 (10)
[6]   Exploring the Potential of Conditional Adversarial Networks for Optical and SAR Image Matching [J].
Merkle, Nina ;
Auer, Stefan ;
Mueller, Rupert ;
Reinartz, Peter .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (06) :1811-1820
[7]   Exploiting Deep Matching and SAR Data for the Geo-Localization Accuracy Improvement of Optical Satellite Images [J].
Merkle, Nina ;
Luo, Wenjie ;
Auer, Stefan ;
Mueller, Rupert ;
Urtasun, Raquel .
REMOTE SENSING, 2017, 9 (06)
[8]  
Quan D, 2018, INT GEOSCI REMOTE SE, P6215, DOI 10.1109/IGARSS.2018.8518653
[9]   Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification [J].
Tian, Xudong ;
Zhang, Zhizhong ;
Lin, Shaohui ;
Qu, Yanyun ;
Xie, Yuan ;
Ma, Lizhuang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :1522-1531
[10]   OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas [J].
Xiang, Yuming ;
Wang, Feng ;
You, Hongjian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (06) :3078-3090