Research of an Unmanned Aerial Vehicle Autonomous Aerial Refueling Docking Method Based on Binocular Vision

被引:5
作者
Gong, Kun [1 ]
Liu, Bo [2 ]
Xu, Xin [1 ]
Xu, Yuelei [1 ]
He, Yakun [2 ]
Zhang, Zhaoxiang [1 ]
Rasol, Jarhinbek [1 ]
机构
[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, Xian 710072, Peoples R China
[2] Chinese Aeronaut Estab, Beijing 100012, Peoples R China
关键词
object detection; pose estimation; binocular vision; autonomous aerial refueling; UAV; DROGUE DETECTION; ROBUST;
D O I
10.3390/drones7070433
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
In this paper, a visual navigation method based on binocular vision and a deep learning approach is proposed to solve the navigation problem of the unmanned aerial vehicle autonomous aerial refueling docking process. First, to meet the requirements of high accuracy and high frame rate in aerial refueling tasks, this paper proposes a single-stage lightweight drogue detection model, which greatly increases the inference speed of binocular images by introducing image alignment and depth-separable convolution and improves the feature extraction capability and scale adaptation performance of the model by using an efficient attention mechanism (ECA) and adaptive spatial feature fusion method (ASFF). Second, this paper proposes a novel method for estimating the pose of the drogue by spatial geometric modeling using optical markers, and further improves the accuracy and robustness of the algorithm by using visual reprojection. Moreover, this paper constructs a visual navigation vision simulation and semi-physical simulation experiments for the autonomous aerial refueling task, and the experimental results show the following: (1) the proposed drogue detection model has high accuracy and real-time performance, with a mean average precision (mAP) of 98.23% and a detection speed of 41.11 FPS in the embedded module; (2) the position estimation error of the proposed visual navigation algorithm is less than & PLUSMN;0.1 m, and the attitude estimation error of the pitch and yaw angle is less than & PLUSMN;0.5 & DEG;; and (3) through comparison experiments with the existing advanced methods, the positioning accuracy of this method is improved by 1.18% compared with the current advanced methods.
引用
收藏
页数:21
相关论文
共 46 条
[1]   COMPUTATIONAL STEREO [J].
BARNARD, ST ;
FISCHLER, MA .
COMPUTING SURVEYS, 1982, 14 (04) :553-572
[2]  
Bin H., 2019, RES CLOSE RANGE HIGH
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
[4]   Simulation Environment for Machine Vision Based Aerial Refueling for UAVs [J].
Campa, Giampiero ;
Napolitano, Marcello R. ;
Fravolini, Mario L. .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2009, 45 (01) :138-151
[5]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[6]   Study on robust aerial docking mechanism with deep learning based drogue detection and docking [J].
Choi, Andrew Jaeyong ;
Yang, Hyeon-Ho ;
Han, Jae-Hung .
MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 154
[7]   Bionic Visual Control for Probe-and-Drogue Autonomous Aerial Refueling [J].
Duan, Haibin ;
Sun, Yongbin ;
Shi, Yuhui .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (02) :848-865
[8]   Modeling and control issues for autonomous aerial refueling for UAVs using a probe-drogue refueling system [J].
Fravolini, ML ;
Ficola, A ;
Campa, G ;
Napolitano, MR ;
Seanor, B .
AEROSPACE SCIENCE AND TECHNOLOGY, 2004, 8 (07) :611-618
[9]   Drogue position measurement of autonomous aerial refueling based on embedded system [J].
Gao, Yang ;
Yang, Shoubo ;
Liu, Xiaolei .
SENSORS AND ACTUATORS A-PHYSICAL, 2023, 353
[10]   Searching for MobileNetV3 [J].
Howard, Andrew ;
Sandler, Mark ;
Chu, Grace ;
Chen, Liang-Chieh ;
Chen, Bo ;
Tan, Mingxing ;
Wang, Weijun ;
Zhu, Yukun ;
Pang, Ruoming ;
Vasudevan, Vijay ;
Le, Quoc V. ;
Adam, Hartwig .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1314-1324