Improving UAV Aerial Imagery Detection Method via Superresolution Synergy

被引:3
作者
Wang, Dianwei [1 ]
Gao, Zehao [1 ]
Fang, Jie [1 ]
Li, Yuanqing [1 ]
Xu, Zhijie [2 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Xian 710100, Peoples R China
[2] Univ Huddersfield, Sch Comp & Engn, Huddersfield HD1 3DH, England
基金
中国国家自然科学基金;
关键词
Feature extraction; Superresolution; Autonomous aerial vehicles; Detectors; Accuracy; Remote sensing; YOLO; Neck; Image reconstruction; Visualization; Eagle-eye vision system; object detection; unmanned aerial vehicle (UAV) imagery; YOLOv5; SMALL OBJECT DETECTION;
D O I
10.1109/JSTARS.2024.3525148
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicles (UAVs) have emerged as versatile tools across various industries, providing valuable insights through aerial image analysis. However, the efficacy of UAV-deployed image detection systems is often limited by the resolution of captured images and the altitudinal constraints of UAV operations. This article introduces a novel integration of the detection system with superresolution networks and image reconstruction techniques, inspired by the exceptional visual capabilities of eagles, to enhance image detail and detection recall from aerial perspectives. The superresolution component utilizes advanced algorithms to upscale the resolution of images captured by UAVs, thereby improving the granularity and clarity of the visual data. Concurrently, image reconstruction techniques are applied to enhance the quality of original images further. In addition, we propose an innovative adaptive feature fusion technique, which not only surpasses traditional concatenation methods in integrating multiscale features effectively but also demonstrates remarkable improvement in feature utilization and further refinement of the fusion process. Extensive experiments conducted on VisDrone2019 and DOTA datasets demonstrate that our integrated system significantly outperforms existing methods in terms of detection precision and recall. Compared to YOLOv5s, recall and mAP50 have increased by 8.89% and 11.11%, respectively, with only a slight increase in the number of parameters and complexity.
引用
收藏
页码:3959 / 3972
页数:14
相关论文
共 58 条
[1]   VFNet: A Convolutional Architecture for Accent Classification [J].
Ahmed, Asad ;
Tangri, Pratham ;
Panda, Anirban ;
Ramani, Dhruv ;
Nevronas, Samarjit Karmakar .
2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019), 2019,
[2]  
Ameur AI, 2024, IEEE T INTELL VEHICL, P1, DOI [10.1109/tiv.2024.3414140, 10.1109/TIV.2024.3414140, DOI 10.1109/TIV.2024.3414140]
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, DOI 10.48550/ARXIV.2004.10934]
[4]   5G network slicing with unmanned aerial vehicles: Taxonomy, survey, and future directions [J].
Bouzid, Tarek ;
Chaib, Noureddine ;
Bensaad, Mohamed Lahcen ;
Oubbati, Omar Sami .
TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2023, 34 (03)
[5]   Cascade R-CNN: Delving into High Quality Object Detection [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6154-6162
[6]   A Technique for Subpixel Analysis of Dynamic Mangrove Ecosystems With Time-Series Hyperspectral Image Data [J].
Chakravortty, Somdatta ;
Li, Jun ;
Plaza, Antonio .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (04) :1244-1252
[7]   RRNet: A Hybrid Detector for Object Detection in Drone-captured Images [J].
Chen, Changrui ;
Zhang, Yu ;
Lv, Qingxuan ;
Wei, Shuo ;
Wang, Xiaorui ;
Sun, Xin ;
Dong, Junyu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :100-108
[8]   R-CNN for Small Object Detection [J].
Chen, Chenyi ;
Liu, Ming-Yu ;
Tuzel, Oncel ;
Xiao, Jianxiong .
COMPUTER VISION - ACCV 2016, PT V, 2017, 10115 :214-230
[9]   DTSSNet: Dynamic Training Sample Selection Network for UAV Object Detection [J].
Chen, Li ;
Liu, Chaoyang ;
Li, Wei ;
Xu, Qizhi ;
Deng, Hongbin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-16
[10]   Disentangle Your Dense Object Detector [J].
Chen, Zehui ;
Yang, Chenhongyi ;
Li, Qiaofei ;
Zhao, Feng ;
Zha, Zheng-Jun ;
Wu, Feng .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :4939-4948