Robust Drogue Positioning System Based on Detection and Tracking for Autonomous Aerial Refueling of UAVs

被引:8
作者
Tong, Kevin W. [1 ]
Wu, Jie [2 ]
Hou, Yu-Hong [3 ,4 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210014, Jiangsu, Peoples R China
[2] China Aeronaut Radio Elect Res Inst, Shanghai 200233, Peoples R China
[3] Northwestern Polytech Univ, Sch Mech Engn, Xian 710129, Peoples R China
[4] Technol & Engn Ctr Chinese Flight Test Estab, Xian 710089, Peoples R China
基金
中国国家自然科学基金;
关键词
Autonomous aerial refueling; drogue detection; drogue tracking; graph convolution network; SIAMESE NETWORKS; CNN;
D O I
10.1109/TASE.2023.3308230
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In modern war, endurance mileage and combat radius are important factors for the combat effectiveness of military aircraft. However, the existing aerial refueling schemes mainly use manual docking operations and complex conditions require pilots to have high operating skills. Therefore, this work proposes a visual positioning system for autonomous aerial refueling without adding cooperation marks, which mainly includes a dynamic graph convolution module for drogue detection and a kernel correlation filter for drogue tracking. Firstly, a dynamic GCN module is designed to generate the correlation matrix to aggregate adjacent high-order features and fuse them with global features extracted from the CNN stream to achieve accurate drogue detection. Then, the multi-scale features extracted from the drogue detector network and the HOG features are input to the filter learning module together, and weighted response maps are fused to alleviate the occlusion and scale change problems in the tracking process. In addition, a visual positioning scheme combining a drogue detector and tracker is introduced to output an accurate drogue ROI area. The effectiveness and robustness of the proposed work are verified by comparison with the mainstream methods on COCO detection datasets and real aerial refueling datasets
引用
收藏
页码:4737 / 4747
页数:11
相关论文
共 40 条
[1]   Fully-Convolutional Siamese Networks for Object Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Henriques, Joao F. ;
Vedaldi, Andrea ;
Torr, Philip H. S. .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :850-865
[2]   Discriminative Scale Space Tracking [J].
Danelljan, Martin ;
Hager, Gustav ;
Khan, Fahad Shahbaz ;
Felsberg, Michael .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (08) :1561-1575
[3]   Boom and receptacle autonomous air refueling using visual snake optical sensor [J].
Doebbler, James ;
Spaeth, Theresa ;
Valasek, John ;
Monda, Mark J. ;
Schaub, Hanspeter .
JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2007, 30 (06) :1753-1769
[4]   Automatic Foreground Detection at 784 FPS for Ultra-High-Speed Human-Machine Interactions [J].
Du, Songlin ;
Cai, Peikun ;
Hu, Tingting ;
Ikenaga, Takeshi .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) :3587-3600
[5]   A binocular vision-based UAVs autonomous aerial refueling platform [J].
Duan, Haibin ;
Li, Han ;
Luo, Qinan ;
Zhang, Cong ;
Li, Cong ;
Li, Pei ;
Deng, Yimin .
SCIENCE CHINA-INFORMATION SCIENCES, 2016, 59 (05)
[6]   Modeling and control issues for autonomous aerial refueling for UAVs using a probe-drogue refueling system [J].
Fravolini, ML ;
Ficola, A ;
Campa, G ;
Napolitano, MR ;
Seanor, B .
AEROSPACE SCIENCE AND TECHNOLOGY, 2004, 8 (07) :611-618
[7]  
Ge Z, 2021, Arxiv, DOI arXiv:2107.08430
[8]  
Girshick Ross, 2015, ICCV, DOI DOI 10.1109/ICCV.2015.169
[9]   High-Speed Tracking with Kernelized Correlation Filters [J].
Henriques, Joao F. ;
Caseiro, Rui ;
Martins, Pedro ;
Batista, Jorge .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) :583-596
[10]   Exploiting the Circulant Structure of Tracking-by-Detection with Kernels [J].
Henriques, Joao F. ;
Caseiro, Rui ;
Martins, Pedro ;
Batista, Jorge .
COMPUTER VISION - ECCV 2012, PT IV, 2012, 7575 :702-715