RTV-SIFT: Harnessing Structure Information for Robust Optical and SAR Image Registration

被引:6
作者
Pang, Siqi [1 ]
Ge, Junyao [1 ]
Hu, Lei [1 ]
Guo, Kaitai [1 ]
Zheng, Yang [1 ]
Zheng, Changli [2 ]
Zhang, Wei [2 ]
Liang, Jimin [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Key Lab Collaborat Intelligence Syst, Minist Educ China, Xian 710071, Peoples R China
[2] Southwest China Res Inst Elect Equipment, Sci & Technol Elect Informat Control Lab, Chengdu 610036, Peoples R China
基金
中国国家自然科学基金;
关键词
image registration; relative total variation (RTV); structure extraction; phase congruency (PC); optical and synthetic aperture radar (SAR) images; PHASE CONGRUENCY; FUSION; DEEP;
D O I
10.3390/rs15184476
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Registration of optical and synthetic aperture radar (SAR) images is challenging because extracting located identically and unique features on both images are tricky. This paper proposes a novel optical and SAR image registration method based on relative total variation (RTV) and scale-invariant feature transform (SIFT), named RTV-SIFT, to extract feature points on the edges of structures and construct structural edge descriptors to improve the registration accuracy. First, a novel RTV-Harris feature point detection method by combining the RTV and the multiscale Harris algorithm is proposed to extract feature points on both images' significant structures. This ensures a high repetition rate of the feature points. Second, the feature point descriptors are constructed on enhanced phase congruency edge (EPCE), which combines the Sobel operator and maximum moment of phase congruency (PC) to extract edges from structured images that enhance robustness to nonlinear intensity differences and speckle noise. Finally, after coarse registration, the position and orientation Euclidean distance (POED) between feature points is utilized to achieve fine feature point matching to improve the registration accuracy. The experimental results demonstrate the superiority of the proposed RTV-SIFT method in different scenes and image
引用
收藏
页数:20
相关论文
共 42 条
[1]   A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration [J].
Chen, Jian ;
Tian, Jie ;
Lee, Noah ;
Zheng, Jian ;
Smith, R. Theodore ;
Laine, Andrew F. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2010, 57 (07) :1707-1718
[2]   SAR-SIFT: A SIFT-Like Algorithm for SAR Images [J].
Dellinger, Flora ;
Delon, Julie ;
Gousseau, Yann ;
Michel, Julien ;
Tupin, Florence .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (01) :453-466
[3]   Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT [J].
Fan, Bin ;
Huo, Chunlei ;
Pan, Chunhong ;
Kong, Qingqun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2013, 10 (04) :657-661
[4]   SAR and Optical Image Registration Using Nonlinear Diffusion and Phase Congruency Structural Descriptor [J].
Fan, Jianwei ;
Wu, Yan ;
Li, Ming ;
Liang, Wenkai ;
Cao, Yice .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (09) :5368-5379
[5]   Comparative Analysis of Detectors and Feature Descriptors for Multispectral Image Matching in Rice Crops [J].
Forero, Manuel G. ;
Mambuscay, Claudia L. ;
Monroy, Maria F. ;
Miranda, Sergio L. ;
Mendez, Dehyro ;
Orlando Valencia, Milton ;
Gomez Selvaraj, Michael .
PLANTS-BASEL, 2021, 10 (09)
[6]   Measures for an Objective Evaluation of the Geometric Correction Process Quality [J].
Goncalves, Hernani ;
Goncalves, Jose A. ;
Corte-Real, Luis .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (02) :292-296
[7]   A deep learning framework for matching of SAR and optical imagery [J].
Hughes, Lloyd Haydn ;
Marcos, Diego ;
Lobry, Sylvain ;
Tuia, Devis ;
Schmitt, Michael .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 169 :166-179
[8]   Optical imaging through clouds and fog [J].
Jaruwatanadilok, S ;
Ishimaru, A ;
Kuga, Y .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2003, 41 (08) :1834-1843
[9]   A review of multimodal image matching: Methods and applications [J].
Jiang, Xingyu ;
Ma, Jiayi ;
Xiao, Guobao ;
Shao, Zhenfeng ;
Guo, Xiaojie .
INFORMATION FUSION, 2021, 73 :22-71
[10]  
Konnik M, 2014, Arxiv, DOI arXiv:1412.4031