A Novel Drogue Pose Estimation Method for Autonomous Aerial Refueling Based on Monocular Vision Sensor

被引:5
作者
Zhao, Kedong [1 ]
Sun, Yongrong [1 ]
Li, Hua [1 ]
Fu, Yulong [1 ]
Zeng, Qinghua [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211106, Peoples R China
关键词
Autonomous aerial refueling (AAR); feature matching; monocular vision; perspective-three-point (P3P) problem; pose estimation; projection invariants; LINE CORRESPONDENCES; PROBE; NAVIGATION; SYSTEM;
D O I
10.1109/JSEN.2022.3216021
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Drogue pose estimation is one of the key problems of autonomous aerial refueling (AAR) during the docking phase. A novel pose estimation method is proposed to remedy the failure of current methods due to the deformation of the flexible drogue. First, the key to flexible drogue pose estimation is suggested, and the concept of space-invariant features is extended. For the construction of 3L features, a preprocessing method is then proposed. Next, the problem of skeleton pose estimation is transformed into a fourth-order polynomial by constructing virtual points and presenting a point feature-based method. Subsequently, a matching method and the projection invariants of the skeleton are proposed. After that, the correspondences of reprojection points are constructed using the matched 3L features. An objective function fusing circle and line features and their derivatives are developed for optimizing the drogue pose base on the correspondences. Ultimately, the key techniques are verified in the synthetic and real data.
引用
收藏
页码:23064 / 23076
页数:13
相关论文
共 44 条
[1]   Visual-Inertial Image-Odometry Network (VIIONet): A Gaussian process regression-based deep architecture proposal for UAV pose estimation [J].
Aslan, Muhammet Fatih ;
Durdu, Akif ;
Sabanci, Kadir .
MEASUREMENT, 2022, 194
[2]   Monocular Visual Odometry Based on Depth and Optical Flow Using Deep Learning [J].
Ban, Xicheng ;
Wang, Hongjian ;
Chen, Tao ;
Wang, Ying ;
Xiao, Yao .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[3]   A P3P problem solver representing all parameters as a linear combination [J].
Banno, Atsuhiko .
IMAGE AND VISION COMPUTING, 2018, 70 :55-62
[4]   Toward Robotic Pseudodynamic Testing for Hybrid Simulations of Air-to-Air Refueling [J].
Bolien, Mario ;
Iravani, Pejman ;
du Bois, Jonathan Luke .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2017, 22 (02) :1004-1013
[5]   Cooperative Decision-Making Under Uncertainties for Multi-Target Surveillance with Multiples UAVs [J].
Capitan, J. ;
Merino, L. ;
Ollero, A. .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2016, 84 (1-4) :371-386
[6]   POSE DETERMINATION FROM LINE-TO-PLANE CORRESPONDENCES - EXISTENCE CONDITION AND CLOSED-FORM SOLUTIONS [J].
CHEN, HH .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1991, 13 (06) :530-541
[7]   Bionic Visual Control for Probe-and-Drogue Autonomous Aerial Refueling [J].
Duan, Haibin ;
Sun, Yongbin ;
Shi, Yuhui .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (02) :848-865
[8]   Robust Cooperative Target Detection for a Vision-Based UAVs Autonomous Aerial Refueling Platform via the Contrast Sensitivity Mechanism of Eagle's Eye [J].
Duan, Haibin ;
Xin, Long ;
Chen, Shanjun .
IEEE AEROSPACE AND ELECTRONIC SYSTEMS MAGAZINE, 2019, 34 (03) :18-30
[9]   New algorithms for the perspective-three-point problem [J].
Gao, XS ;
Chen, HF .
JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2001, 16 (03) :194-207
[10]   Real-Time Navigation for Drogue-Type Autonomous Aerial Refueling Using Vision-Based Deep Learning Detection [J].
Garcia, Jorge Alberto Banuelos ;
Younes, Ahmad Bani .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (04) :2225-2246