Template matching based on convolution neural network for UAV visual localization

被引:15
作者
Cao, Yuqing [1 ]
Ren, Kan [1 ]
Chen, Qian [1 ]
机构
[1] Nanjing Univ Sci & Technol, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Nanjing 210094, Peoples R China
来源
OPTIK | 2023年 / 283卷
基金
中国国家自然科学基金;
关键词
Unmanned aerial vehicle (UAV); Template matching; Visual localization; Convolutional neural network;
D O I
10.1016/j.ijleo.2023.170920
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Currently, unmanned aerial vehicle (UAVs) are used in many fields, among which UAV locali-zation is the key to UAV autonomous flight capability, and how to locate UAVs in the absence of GNSS signals is a difficult task. In recent years, deep learning has developed rapidly, among which convolutional neural networks are widely used in visual images. In this paper, we apply the convolutional neural network DenseNet to the task of matching between UAV images and satellite remote sensing images for visual localization of UAVs. We make some improvements to address the problems in practice. We propose a quality-aware template matching method based on adaptive adjustment of convolutional feature weights to enhance the feature extraction capability of the model, and introduce a fusion mechanism of multi-scale feature layers. The feature maps of UAV images and satellite images are quality scored so as to locate the position of UAV in satellite images. Qualitative and quantitative experiments are conducted, and the results show the effectiveness and superiority of the method.
引用
收藏
页数:12
相关论文
共 28 条
[1]   Convolutional Neural Network-Based Deep Urban Signatures with Application to Drone Localization [J].
Amer, Karim ;
Samy, Mohamed ;
ElHakim, Reda ;
Shaker, Mahmoud ;
ElHelw, Mohamed .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2138-2145
[2]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[3]   Optimizing Border Patrol Operations Using Unmanned Aerial Vehicles [J].
Bein, Doina ;
Bein, Wolfgang ;
Karki, Ashish ;
Madan, Bharat B. .
2015 12TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY - NEW GENERATIONS, 2015, :479-484
[4]  
Chao HY, 2013, P AMER CONTR CONF, P3858
[5]   QATM: Quality-Aware Template Matching For Deep Learning [J].
Cheng, Jiaxin ;
Wu, Yue ;
Abd-Almageed, Wael ;
Natarajan, Premkumar .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11545-11554
[6]   A review on absolute visual localization for UAV [J].
Couturier, Andy ;
Akhloufi, Moulay A. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 135
[7]  
Demidova Kristina, 2020, 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus). Proceedings, P280, DOI 10.1109/EIConRus49466.2020.9039465
[8]   A Practical Cross-View Image Matching Method between UAV and Satellite for UAV-Based Geo-Localization [J].
Ding, Lirong ;
Zhou, Ji ;
Meng, Lingxuan ;
Long, Zhiyong .
REMOTE SENSING, 2021, 13 (01) :1-22
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]