A Review of Keypoints' Detection and Feature Description in Image Registration

被引:27
作者
Liu, Cuiyin [1 ]
Xu, Jishang [1 ]
Wang, Feng [2 ,3 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Yunnan, Peoples R China
[2] Guangzhou Univ, Sch Phys & Elect Engn, Guangzhou 51006, Peoples R China
[3] Guangzhou Univ, Astrophys Ctr, Guangzhou 51006, Peoples R China
基金
中国国家自然科学基金;
关键词
ROBUST; SAR;
D O I
10.1155/2021/8509164
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
For image registration, feature detection and description are critical steps that identify the keypoints and describe them for the subsequent matching to estimate the geometric transformation parameters between two images. Recently, there has been a large increase in the research methods of detection operators and description operators, from traditional methods to deep learning methods. To solve the problem, that is, which operator is suitable for specific application problems under different imaging conditions, the paper systematically reviewed commonly used descriptors and detectors from artificial methods to deep learning methods, and the corresponding principle, analysis, and comparative experiments are given as well. We introduce the handcrafted detectors including FAST, BRISK, ORB, SURF, SIFT, and KAZE and the handcrafted descriptors including BRISK, FREAK, BRIEF, SURF, ORB, SIFT, KAZE. At the same time, we review detectors based on deep learning technology including DetNet, TILDE, LIFT, multiscale detector, SuperPoint, and descriptors based on deep learning including pretrained descriptor, Siamese descriptor, LIFT, triplet network, and SuperPoint. Two group of comparison experiments are compared comprehensively and objectively on representative datasets. Finally, we concluded with insightful discussions and conclusions of descriptor and detector selection for specific application problem and hope this survey can be a reference for researchers and engineers in image registration and related fields.
引用
收藏
页数:25
相关论文
共 98 条
[41]   Efficient Properties-Based Learning for Mismatch Removal [J].
Li, Yanping ;
Huang, Qian ;
Liu, Yizhang ;
Huang, Yuan ;
Sun, Xiaoqing .
IEEE ACCESS, 2019, 7 :149612-149622
[42]   Image retrieval from remote sensing big data: A survey [J].
Li, Yansheng ;
Ma, Jiayi ;
Zhang, Yongjun .
INFORMATION FUSION, 2021, 67 :94-115
[43]  
Liao R, 2017, AAAI CONF ARTIF INTE, P4168
[44]   LCC-Demons: A robust and accurate symmetric diffeomorphic registration algorithm [J].
Lorenzi, M. ;
Ayache, N. ;
Frisoni, G. B. ;
Pennec, X. .
NEUROIMAGE, 2013, 81 :470-483
[45]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[46]   ASLFeat: Learning Local Features of Accurate Shape and Localization [J].
Luo, Zixin ;
Zhou, Lei ;
Bai, Xuyang ;
Chen, Hongkai ;
Zhang, Jiahui ;
Yao, Yao ;
Li, Shiwei ;
Fang, Tian ;
Quan, Long .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6588-6597
[47]   Image Matching from Handcrafted to Deep Features: A Survey [J].
Ma, Jiayi ;
Jiang, Xingyu ;
Fan, Aoxiang ;
Jiang, Junjun ;
Yan, Junchi .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (01) :23-79
[48]   Deep learning in remote sensing applications: A meta-analysis and review [J].
Ma, Lei ;
Liu, Yu ;
Zhang, Xueliang ;
Ye, Yuanxin ;
Yin, Gaofei ;
Johnson, Brian Alan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 152 :166-177
[49]   Training data independent image registration using generative adversarial networks and domain adaptation [J].
Mahapatra, Dwarikanath ;
Ge, Zongyuan .
PATTERN RECOGNITION, 2020, 100
[50]   Adaptive and Generic Corner Detection Based on the Accelerated Segment Test [J].
Mair, Elmar ;
Hager, Gregory D. ;
Burschka, Darius ;
Suppa, Michael ;
Hirzinger, Gerhard .
COMPUTER VISION-ECCV 2010, PT II, 2010, 6312 :183-+