UAV Geo-Localization Dataset and Method Based on Cross-View Matching

被引:0
作者
Yao, Yuwen [1 ]
Sun, Cheng [1 ]
Wang, Tao [1 ]
Yang, Jianxing [1 ]
Zheng, Enhui [1 ]
机构
[1] China Jiliang Univ, Sch Mech & Elect Engn, Hangzhou 310018, Peoples R China
关键词
UAV localization; geo-location datasets; satellite; deep learning;
D O I
10.3390/s24216905
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The stable flight of drones relies on Global Navigation Satellite Systems (GNSS). However, in complex environments, GNSS signals are prone to interference, leading to flight instability. Inspired by cross-view machine learning, this paper introduces the VDUAV dataset and designs the VRLM network architecture, opening new avenues for cross-view geolocation. First, to address the limitations of traditional datasets with limited scenarios, we propose the VDUAV dataset. By leveraging the virtual-real mapping of latitude and longitude coordinates, we establish a digital twin platform that incorporates 3D models of real-world environments. This platform facilitates the creation of the VDUAV dataset for cross-view drone localization, significantly reducing the cost of dataset production. Second, we introduce a new baseline model for cross-view matching, the Virtual Reality Localization Method (VRLM). The model uses FocalNet as its backbone and extracts multi-scale features from both drone and satellite images through two separate branches. These features are then fused using a Similarity Computation and Feature Fusion (SCFF) module. By applying a weighted fusion of multi-scale features, the model preserves critical distinguishing features in the images, leading to substantial improvements in both processing speed and localization accuracy. Experimental results demonstrate that the VRLM model outperforms FPI on the VDUAV dataset, achieving an accuracy increase to 83.35% on the MA@20 metric and a precision of 74.13% on the RDS metric.
引用
收藏
页数:22
相关论文
共 47 条
[1]  
Catalano I., 2023, P 2023 IEEE INT C RO, P1
[2]   Transformer Tracking [J].
Chen, Xin ;
Yan, Bin ;
Zhu, Jiawen ;
Wang, Dong ;
Yang, Xiaoyun ;
Lu, Huchuan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8122-8131
[3]   A review on absolute visual localization for UAV [J].
Couturier, Andy ;
Akhloufi, Moulay A. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 135
[4]   A Novel Geo-Localization Method for UAV and Satellite Images Using Cross-View Consistent Attention [J].
Cui, Zhuofan ;
Zhou, Pengwei ;
Wang, Xiaolong ;
Zhang, Zilun ;
Li, Yingxuan ;
Li, Hongbo ;
Zhang, Yu .
REMOTE SENSING, 2023, 15 (19)
[5]   Vision-Based UAV Self-Positioning in Low-Altitude Urban Environments [J].
Dai, Ming ;
Zheng, Enhui ;
Feng, Zhenhua ;
Qi, Lei ;
Zhuang, Jiedong ;
Yang, Wankou .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :493-508
[6]  
Dai M, 2024, Arxiv, DOI arXiv:2208.06561
[7]  
Delibasoglu I, 2021, Arxiv, DOI arXiv:2103.11460
[8]  
Devlin J, 2019, Arxiv, DOI arXiv:1810.04805
[9]   A Practical Cross-View Image Matching Method between UAV and Satellite for UAV-Based Geo-Localization [J].
Ding, Lirong ;
Zhou, Ji ;
Meng, Lingxuan ;
Long, Zhiyong .
REMOTE SENSING, 2021, 13 (01) :1-22
[10]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929