A Time Sequence Images Matching Method Based on the Siamese Network

被引:17
|
作者
Tao, Bo [1 ]
Huang, Licheng [2 ]
Zhao, Haoyi [2 ]
Li, Gongfa [1 ]
Tong, Xiliang [2 ]
机构
[1] Wuhan Univ Sci & Technol, Key Lab Met Equipment & Control Technol, Minist Educ, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
基金
中国国家自然科学基金;
关键词
similarity; image pair; the Siamese network; correlation matrix; comparison; REGISTRATION;
D O I
10.3390/s21175900
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Method of Sea Wave Matching Based on Siamese Network
    Chen, Chenhao
    Lu, Cunwei
    Yang, Ying
    PROCEEDINGS OF THE SEVENTH ASIA INTERNATIONAL SYMPOSIUM ON MECHATRONICS, VOL II, 2020, 589 : 867 - 872
  • [2] Object matching between visible and infrared images using a Siamese network
    Wuxin Li
    Qian Chen
    Guohua Gu
    Xiubao Sui
    Applied Intelligence, 2022, 52 : 7734 - 7746
  • [3] Object matching between visible and infrared images using a Siamese network
    Li, Wuxin
    Chen, Qian
    Gu, Guohua
    Sui, Xiubao
    APPLIED INTELLIGENCE, 2022, 52 (07) : 7734 - 7746
  • [4] Similarity matching of medical question based on Siamese network
    Li, Qing
    He, Song
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2023, 23 (01)
  • [5] Matching Recommendations based on Siamese Network and Metric Learning
    Yuan, Huiru
    Liu, Guannan
    Li, Hong
    Wang, Lihong
    2018 15TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2018,
  • [6] Similarity matching of medical question based on Siamese network
    Qing Li
    Song He
    BMC Medical Informatics and Decision Making, 23
  • [7] A Robust and Accurate End-to-End Template Matching Method Based on the Siamese Network
    Ren, Qiang
    Zheng, Yongbin
    Sun, Peng
    Xu, Wanying
    Zhu, Di
    Yang, Dongxu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] Fashion clothes matching scheme based on Siamese Network and AutoEncoder
    Gao, Guangyu
    Liu, Liling
    Wang, Li
    Zhang, Yihang
    MULTIMEDIA SYSTEMS, 2019, 25 (06) : 593 - 602
  • [9] Fashion clothes matching scheme based on Siamese Network and AutoEncoder
    Guangyu Gao
    Liling Liu
    Li Wang
    Yihang Zhang
    Multimedia Systems, 2019, 25 : 593 - 602
  • [10] Siamese Network Features for Image Matching
    Melekhov, Iaroslav
    Kannala, Juho
    Rahtu, Esa
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 378 - 383