UAV Geo-Localization Dataset and Method Based on Cross-View Matching

被引:0
作者
Yao, Yuwen [1 ]
Sun, Cheng [1 ]
Wang, Tao [1 ]
Yang, Jianxing [1 ]
Zheng, Enhui [1 ]
机构
[1] China Jiliang Univ, Sch Mech & Elect Engn, Hangzhou 310018, Peoples R China
关键词
UAV localization; geo-location datasets; satellite; deep learning;
D O I
10.3390/s24216905
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
The stable flight of drones relies on Global Navigation Satellite Systems (GNSS). However, in complex environments, GNSS signals are prone to interference, leading to flight instability. Inspired by cross-view machine learning, this paper introduces the VDUAV dataset and designs the VRLM network architecture, opening new avenues for cross-view geolocation. First, to address the limitations of traditional datasets with limited scenarios, we propose the VDUAV dataset. By leveraging the virtual-real mapping of latitude and longitude coordinates, we establish a digital twin platform that incorporates 3D models of real-world environments. This platform facilitates the creation of the VDUAV dataset for cross-view drone localization, significantly reducing the cost of dataset production. Second, we introduce a new baseline model for cross-view matching, the Virtual Reality Localization Method (VRLM). The model uses FocalNet as its backbone and extracts multi-scale features from both drone and satellite images through two separate branches. These features are then fused using a Similarity Computation and Feature Fusion (SCFF) module. By applying a weighted fusion of multi-scale features, the model preserves critical distinguishing features in the images, leading to substantial improvements in both processing speed and localization accuracy. Experimental results demonstrate that the VRLM model outperforms FPI on the VDUAV dataset, achieving an accuracy increase to 83.35% on the MA@20 metric and a precision of 74.13% on the RDS metric.
引用
收藏
页数:22
相关论文
共 47 条
[21]   Towards the Unmanned Aerial Vehicles (UAVs): A Comprehensive Review [J].
Mohsan, Syed Agha Hassnain ;
Khan, Muhammad Asghar ;
Noor, Fazal ;
Ullah, Insaf ;
Alsharif, Mohammed H. .
DRONES, 2022, 6 (06)
[22]   A Comprehensive Review of Micro UAV Charging Techniques [J].
Mohsan, Syed Agha Hassnain ;
Othman, Nawaf Qasem Hamood ;
Khan, Muhammad Asghar ;
Amjad, Hussain ;
Zywiolek, Justyna .
MICROMACHINES, 2022, 13 (06)
[23]   Assisting UAV Localization Via Deep Contextual Image Matching [J].
Mughal, Muhammad Hamza ;
Khokhar, Muhammad Jawad ;
Shahzad, Muhammad .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :2445-2457
[24]   Artificial Intelligence Approaches for UAV Navigation: Recent Advances and Future Challenges [J].
Rezwan, Sifat ;
Choi, Wooyeol .
IEEE ACCESS, 2022, 10 :26320-26339
[25]   Latest Advances in the Global Navigation Satellite System-Reflectometry (GNSS-R) Field [J].
Rodriguez-Alvarez, Nereida ;
Munoz-Martin, Joan Francesc ;
Morris, Mary .
REMOTE SENSING, 2023, 15 (08)
[26]   Evaluation of multi-camera images in different SfM-MVS based photogrammetric software and comparison of digital products in generating 3D city models [J].
Saglam, Ibrahim Enes ;
Karasaka, Lutfiye .
AIN SHAMS ENGINEERING JOURNAL, 2024, 15 (05)
[27]  
Shi Yuge, 2019, Advances in Neural Information Processing Systems, V32
[28]  
Shi YJ, 2020, AAAI CONF ARTIF INTE, V34, P11990
[29]   Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching [J].
Shi, Yujiao ;
Yu, Xin ;
Campbell, Dylan ;
Li, Hongdong .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4063-4071
[30]   A Review of quadrotor UAV: Control and SLAM methodologies ranging from conventional to innovative approaches [J].
Sonugur, Guray .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 161