Drone Based RGBT Tracking with Dual-Feature Aggregation Network

被引:7
|
作者
Gao, Zhinan [1 ]
Li, Dongdong [1 ]
Wen, Gongjian [1 ]
Kuai, Yangliu [2 ]
Chen, Rui [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[2] Natl Univ Def Technol, Coll Intelligent Sci & Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
RGBT tracking; Drone based object tracking; transformer; feature aggregation;
D O I
10.3390/drones7090585
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
In the field of drone-based object tracking, utilization of the infrared modality can improve the robustness of the tracker in scenes with severe illumination change and occlusions and expand the applicable scene of the drone object tracking task. Inspired by the great achievements of Transformer structure in the field of RGB object tracking, we design a dual-modality object tracking network based on Transformer. To better address the problem of visible-infrared information fusion, we propose a Dual-Feature Aggregation Network that utilizes attention mechanisms in both spatial and channel dimensions to aggregate heterogeneous modality feature information. The proposed algorithm has achieved better performance by comparing with the mainstream algorithms in the drone-based dual-modality object tracking dataset VTUAV. Additionally, the algorithm is lightweight and can be easily deployed and executed on a drone edge computing platform. In summary, the proposed algorithm is mainly applicable to the field of drone dual-modality object tracking and the algorithm is optimized so that it can be deployed on the drone edge computing platform. The effectiveness of the algorithm is proved by experiments and the scope of drone object tracking is extended effectively.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Quality-Aware Feature Aggregation Network for Robust RGBT Tracking
    Zhu, Yabin
    Li, Chenglong
    Tang, Jin
    Luo, Bin
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (01): : 121 - 130
  • [2] RGBT dual-modal Siamese tracking network with feature fusion
    Shen Y.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2021, 50 (03):
  • [3] Dense Feature Aggregation and Pruning for RGBT Tracking
    Zhu, Yabin
    Li, Chenglong
    Luo, Bin
    Tang, Jin
    Wang, Xiao
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 465 - 472
  • [4] Dual-Feature Aggregation Network for No-Reference Image Quality Assessment
    Chen, Yihua
    Chen, Zhiyuan
    Yu, Mengzhu
    Tang, Zhenjun
    MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 149 - 161
  • [5] SiamTFA: Siamese Triple-Stream Feature Aggregation Network for Efficient RGBT Tracking
    Zhang, Jianming
    Qin, Yu
    Fan, Shimeng
    Xiao, Zhu
    Zhang, Jin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (02) : 1900 - 1913
  • [6] RGBT Tracking based on modality feature enhancement
    Sulan Zhai
    Yi Wu
    Lei Liu
    Jin Tang
    Multimedia Tools and Applications, 2024, 83 : 29311 - 29330
  • [7] RGBT Tracking based on modality feature enhancement
    Zhai, Sulan
    Wu, Yi
    Liu, Lei
    Tang, Jin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (10) : 29311 - 29330
  • [8] FcFNet: A Challenge-Based Feature Complementary Fusion Network for RGBT Tracking
    Wang, Wensheng
    Li, Congjian
    Zhang, Di
    Zhou, Huihui
    Xie, Mingli
    Zhou, Haoran
    Fu, Kun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 2239 - 2251
  • [9] Online classification jointed RGBT tracking based on the dual attention Siamese network
    Zhang Z.
    Tian C.
    Zhou H.
    Tian X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2022, 49 (06): : 76 - 85
  • [10] Dynamic Feature-Memory Transformer Network for RGBT Tracking
    Li, Muyang
    Zhang, Ping
    Yan, Miao
    Chen, Hu
    Wu, Changke
    IEEE SENSORS JOURNAL, 2023, 23 (17) : 19692 - 19703