Bird and UAVs Recognition Detection and Tracking Based on Improved YOLOv9-DeepSORT

被引:0
作者
Zhu, Jincan [1 ]
Ma, Chenhao [1 ]
Rong, Jian [1 ]
Cao, Yong [1 ]
机构
[1] Southwest Forestry Univ, Coll Big Data & Intelligent Engn, Kunming 650000, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Birds; Target tracking; Drones; Accuracy; Feature extraction; Biological system modeling; Target recognition; Data models; YOLO; Bird protection; AKConv dynamic convolution; AFF channel attention; CAM feature enhancement; YOLOv9 and DeepSORT;
D O I
10.1109/ACCESS.2024.3475629
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, the protection of birds, especially endangered birds, faces major challenges. In the process of protection, birds are often mixed with various drones, and it is difficult to accurately count the number of endangered birds, especially at night, which brings great difficulties to bird protection work. So tracking and identifying birds and drones is essential to ensure the accuracy and efficiency of bird conservation efforts. To solve these problems, this paper proposes a new multi-target tracking (MOT) model based on the combination of YOLOv9 detection algorithm and DeepSORT tracking algorithm. Firstly, the original RepNSCPELAN4 module is replaced by CAM context feature enhancement module in Backbone to improve the model's ability to extract small target features. Following this, the AFF channel attention mechanism has been integrated with RepNSCPELAN4 in the Head section to create the RepNSCPELAN4-AFF module, which aims to better address semantic and scale inconsistencies. Finally, a new RepNSCPELAN4-AKConv module has been developed using the AKConv dynamic Convolution module to replace the RepNSCPELAN4 module in the original Head section, enabling the model to more effectively capture detailed and contextual information. In the bird-UAV visible light comprehensive dataset proposed in this study, the mAP0.50 and F1 Score of all categories are 81.3% and 71.9% respectively by the improved YOLOv9-DeepSORT model. The mAP0.50 and F1 scores of individual birds are 89.1% and 82.4%, respectively. Compared to the Basic YOLOv9 model, the former improves by 7.9% and 5.3%, while the latter improves by 23.9% and 17.0%. On infrared datasets, compared to the original model, the mAP0.50 and F1 scores of the improved model improved by 3.2% and 1.4% across all categories compared to the original model. The average accuracy of identifying individual birds and similarly shaped fixed-wing drones also improved by 2.2% and 7.5% respectively. Moreover, on the mixed visible light and infrared data sets, the model get mAP0.50 of 81.8% higher 0.9% than that of the YOLOv9. These experiments demonstrate the improved YOLOv9-DeepSORT method can expand the multiscene application range of bird recognition and tracking models, effectively promoting the extraction of video frame features in multi-target tracking.
引用
收藏
页码:147942 / 147957
页数:16
相关论文
共 65 条
  • [1] Aharon N, 2022, Arxiv, DOI [arXiv:2206.14651, DOI 10.48550/ARXIV.2206.14651]
  • [2] Archana U., 2023, 2023 International Conference on Inventive Computation Technologies (ICICT), P614, DOI 10.1109/ICICT57646.2023.10133938
  • [3] Basar T., 2001, A New Approach to Linear Filtering and Prediction Problems, P167, DOI DOI 10.1109/9780470544334.CH9
  • [4] Hearing to the Unseen: AudioMoth and BirdNET as a Cheap and Easy Method for Monitoring Cryptic Bird Species
    Bota, Gerard
    Manzano-Rubio, Robert
    Catalan, Lidia
    Gomez-Catasus, Julia
    Perez-Granados, Cristian
    [J]. SENSORS, 2023, 23 (16)
  • [5] Optimization Research of Bird Detection Algorithm Based on YOLO in Deep Learning Environment
    Chen, Xi
    Zhang, Zhenyu
    [J]. INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2024,
  • [6] An Efficient Method for Monitoring Birds Based on Object Detection and Multi-Object Tracking Networks
    Chen, Xian
    Pu, Hongli
    He, Yihui
    Lai, Mengzhen
    Zhang, Daike
    Chen, Junyang
    Pu, Haibo
    [J]. ANIMALS, 2023, 13 (10):
  • [7] Chen Yutong, 2022, 2022 IEEE 22nd International Conference on Communication Technology (ICCT), P1458, DOI 10.1109/ICCT56141.2022.10072560
  • [8] Chicco D, 2021, METHODS MOL BIOL, V2190, P73, DOI 10.1007/978-1-0716-0826-5_3
  • [9] Chong C.-Y., 2021, 2021 IEEE 24 INT C I, P1
  • [10] Cooper JEJ, 2023, LANDSCAPE URBAN PLAN, V230, DOI 10.1016/j.landurbplan.2022.104629