A continuation method for image registration based on dynamic adaptive kernel

被引:2
作者
Ma, Yuandong [1 ]
Wang, Boyuan [1 ]
Lin, Hezheng [1 ,2 ]
Liu, Chun [1 ]
Hu, Mengjie [1 ]
Song, Qing [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing 10000, Peoples R China
[2] Beijing Yixiao Technol Co Ltd, Beijing 10000, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Image registration; Convolutional neural network; Coarse to fine level registration; Adaptive kernel;
D O I
10.1016/j.neunet.2023.06.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image registration is a fundamental problem in computer vision and robotics. Recently, learning based image registration methods have made great progress. However, these methods are sensitive to abnormal transformation and have insufficient robustness, which leads to more mismatched points in the actual environment. In this paper, we propose a new registration framework based on ensemble learning and dynamic adaptive kernel. Specifically, we first use a dynamic adaptive kernel to extract deep features at the coarse level to guide fine-level registration. Then we added an adaptive feature pyramid network based on the integrated learning principle to realize the fine-level feature extraction. Through different scale, receptive fields, not only the local geometric information of each point is considered, but also its low texture information at the pixel level is considered. According to the actual registration environment, fine features are adaptively obtained to reduce the sensitivity of the model to abnormal transformation. We use the global receptive field provided in the transformer to obtain feature descriptors based on these two levels. In addition, we use the cosine loss directly defined on the corresponding relationship to train the network and balance the samples, to achieve feature point registration based on the corresponding relationship. Extensive experiments on object-level and scene level datasets show that the proposed method outperforms existing state-of-the-art techniques by a large margin. More critically, it has the best generalization ability in unknown scenes with different sensor modes.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:774 / 785
页数:12
相关论文
共 54 条
  • [51] The Euclidean embedding learning based on convolutional neural network for stereo matching
    Yang, Menglong
    Liu, Yiguang
    You, Zhisheng
    [J]. NEUROCOMPUTING, 2017, 267 : 195 - 200
  • [52] Learning to Find Good Correspondences
    Yi, Kwang Moo
    Trulls, Eduard
    Ono, Yuki
    Lepetit, Vincent
    Salzmann, Mathieu
    Fua, Pascal
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2666 - 2674
  • [53] LIFT: Learned Invariant Feature Transform
    Yi, Kwang Moo
    Trulls, Eduard
    Lepetit, Vincent
    Fua, Pascal
    [J]. COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 : 467 - 483
  • [54] Learning Two-View Correspondences and Geometry Using Order-Aware Network
    Zhang, Jiahui
    Sun, Dawei
    Luo, Zixin
    Yao, Anbang
    Zhou, Lei
    Shen, Tianwei
    Chen, Yurong
    Quan, Long
    Liao, Hongen
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 5844 - 5853