A continuation method for image registration based on dynamic adaptive kernel

被引:2
作者
Ma, Yuandong [1 ]
Wang, Boyuan [1 ]
Lin, Hezheng [1 ,2 ]
Liu, Chun [1 ]
Hu, Mengjie [1 ]
Song, Qing [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing 10000, Peoples R China
[2] Beijing Yixiao Technol Co Ltd, Beijing 10000, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Image registration; Convolutional neural network; Coarse to fine level registration; Adaptive kernel;
D O I
10.1016/j.neunet.2023.06.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image registration is a fundamental problem in computer vision and robotics. Recently, learning based image registration methods have made great progress. However, these methods are sensitive to abnormal transformation and have insufficient robustness, which leads to more mismatched points in the actual environment. In this paper, we propose a new registration framework based on ensemble learning and dynamic adaptive kernel. Specifically, we first use a dynamic adaptive kernel to extract deep features at the coarse level to guide fine-level registration. Then we added an adaptive feature pyramid network based on the integrated learning principle to realize the fine-level feature extraction. Through different scale, receptive fields, not only the local geometric information of each point is considered, but also its low texture information at the pixel level is considered. According to the actual registration environment, fine features are adaptively obtained to reduce the sensitivity of the model to abnormal transformation. We use the global receptive field provided in the transformer to obtain feature descriptors based on these two levels. In addition, we use the cosine loss directly defined on the corresponding relationship to train the network and balance the samples, to achieve feature point registration based on the corresponding relationship. Extensive experiments on object-level and scene level datasets show that the proposed method outperforms existing state-of-the-art techniques by a large margin. More critically, it has the best generalization ability in unknown scenes with different sensor modes.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:774 / 785
页数:12
相关论文
共 54 条
  • [1] [Anonymous], 2022, CVPR 2022 IMAGE MATC
  • [2] SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
    Ao, Sheng
    Hu, Qingyong
    Yang, Bo
    Markham, Andrew
    Guo, Yulan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11748 - 11757
  • [3] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [4] HPatches: A benchmark and evaluation of handcrafted and learned local descriptors
    Balntas, Vassileios
    Lenc, Karel
    Vedaldi, Andrea
    Mikolajczyk, Krystian
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3852 - 3861
  • [5] GMS: Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence
    Bian, JiaWang
    Lin, Wen-Yan
    Matsushita, Yasuyuki
    Yeung, Sai-Kit
    Nguyen, Tan-Dat
    Cheng, Ming-Ming
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2828 - 2837
  • [6] Bromley J., 1993, ADV NEURAL INFORM PR, V6, P10
  • [7] An extension of the Jeffreys-Matusita distance to multiclass cases for feature selection
    Bruzzone, L
    Roli, F
    Serpico, SB
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1995, 33 (06): : 1318 - 1321
  • [8] BRIEF: Binary Robust Independent Elementary Features
    Calonder, Michael
    Lepetit, Vincent
    Strecha, Christoph
    Fua, Pascal
    [J]. COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 : 778 - 792
  • [9] ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
    Dai, Angela
    Chang, Angel X.
    Savva, Manolis
    Halber, Maciej
    Funkhouser, Thomas
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2432 - 2443
  • [10] Deschaud JE, 2018, IEEE INT CONF ROBOT, P2480