Fast Dual-Feature Extraction Based on Tightly Coupled Lightweight Network for Visual Place Recognition

被引:0
作者
Hu, Xiaofei [1 ]
Zhou, Yang [1 ]
Lyu, Liang [1 ]
Lan, Chaozhen [1 ]
Shi, Qunshan [1 ]
Hou, Mingbo [1 ]
机构
[1] PLA Strateg Support Force Informat Engn Univ, Inst Geospatial Informat, Zhengzhou 450001, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Quantization (signal); Training; Convolutional neural networks; Location awareness; Visualization; Task analysis; Learning systems; Visual place recognition; dual-feature extraction; tightly coupled; learned step size quantization;
D O I
10.1109/ACCESS.2023.3331371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual place recognition (VPR) is a task that aims to predict the location of an image based on the existing images. Because image data can often be massive, extracting features efficiently is critical. To solve the problems of model redundancy and poor time efficiency in feature extraction, this study proposes a fast dual-feature extraction method based on a tightly coupled lightweight network. The tightly coupled network extracts local and global features in a unified model which has a lightweight backbone. Learned step size quantization is then performed to reduce the computational overhead in the inference stage. Additionally, an efficient channel attention module ensures feature representation ability. Efficiency and performance experiments on different hardware platforms showed that the proposed algorithm incurred significant runtime savings for feature extraction, and the inference was 2.9-4.0 times faster than that in the general model. The experimental results confirmed that the proposed method can significantly improve VPR efficiency while ensuring accuracy.
引用
收藏
页码:127855 / 127865
页数:11
相关论文
共 41 条
  • [1] Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/CVPR.2016.572, 10.1109/TPAMI.2017.2711011]
  • [2] All about VLAD
    Arandjelovic, Relja
    Zisserman, Andrew
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1578 - 1585
  • [3] Bengio Y, 2013, Arxiv, DOI arXiv:1308.3432
  • [4] LSQ plus : Improving low-bit quantization through learnable offsets and better initialization
    Bhalgat, Yash
    Lee, Jinwon
    Nagel, Markus
    Blankevoort, Tijmen
    Kwak, Nojun
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2978 - 2985
  • [5] Bingyi Cao, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12365), P726, DOI 10.1007/978-3-030-58565-5_43
  • [6] Visual Place Recognition by spatial matching of high-level CNN features
    Camara, Luis G.
    Preucil, Libor
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2020, 133
  • [7] Mobile-Former: Bridging MobileNet and Transformer
    Chen, Yinpeng
    Dai, Xiyang
    Chen, Dongdong
    Liu, Mengchen
    Dong, Xiaoyi
    Yuan, Lu
    Liu, Zicheng
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5260 - 5269
  • [8] Loop closure detection based on local-global similarity measurement strategies
    Dian, Songyi
    Yin, Yanjie
    Wu, Chao
    Zhong, Yuzhong
    Zhang, Hong
    Yuan, Haobin
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (02)
  • [9] Fang YC, 2020, IEEE INT VEH SYM, P1885, DOI [10.1109/IV47402.2020.9304612, 10.1109/iv47402.2020.9304612]
  • [10] A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation Assistance
    Fang, Yicheng
    Yang, Kailun
    Cheng, Ruiqi
    Sun, Lei
    Wang, Kaiwei
    [J]. SENSORS, 2020, 20 (15) : 1 - 24