STransLOT: splitting-refusion transformer for low-light object tracking

被引:0
|
作者
Cai, Zhongwang [1 ]
He, Dunyun [1 ]
Yang, Zhen [1 ,2 ]
Yang, Fan [1 ]
Yin, Zhijian [1 ]
机构
[1] Jiangxi Sci & Technol Normal Univ, Sch Commun & Elect, West Sugarbush St, Nanchang 330013, Jiangxi, Peoples R China
[2] Minist Educ, Key Lab Syst Control & Informat Proc, Rd Dongguan, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Splitting; Refusion; Low-light tracking; Transformer;
D O I
10.1007/s11042-023-15256-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the field of tracking, more and more trackers are using the great potential of the transformer to form the framework. Most of them use the Siamese-based backbone and employ the attention mechanism to capture the spatio-temporal features, which benefits the similarity learning and establishing the positional relationship between the template patch and the search region. However, tracking a target accurately in low-light scenarios is one of the most challenging tasks in recent years. To alleviate this defect, we propose an improved Splitting-refusion Transformer for Low-light Object Tracking (STransLOT). Building on the irreplaceable success that Transformer trackers have achieved in visual tracking this year, our STransLOT is combined with a Transformer-like feature fusion module and a classical prediction head. The pixel-level splitting module splits the original image into the part high-light image and part low-light image, while the refusion module fuses the feature maps of these three inputs to improve the low-light feature representation. Experiments show that our STransLOT achieves remarkable results on the LOTD50 dataset and other low-light sequences of public benchmarks.
引用
收藏
页码:64015 / 64036
页数:22
相关论文
共 50 条
  • [1] Low-light DEtection TRansformer (LDETR): object detection in low-light and adverse weather conditions
    Tiwari A.K.
    Pattanaik M.
    Sharma G.K.
    Multimedia Tools and Applications, 2024, 83 (36) : 84231 - 84248
  • [2] A Comprehensive Study of Object Tracking in Low-Light Environments
    Yi, Anqi
    Anantrasirichai, Nantheera
    SENSORS, 2024, 24 (13)
  • [3] UniRTL: A universal RGBT and low-light benchmark for object tracking
    Zhang, Lian
    Wang, Lingxue
    Wu, Yuzhen
    Chen, Mingkun
    Zheng, Dezhi
    Cao, Liangcai
    Zeng, Bangze
    Cai, Yi
    PATTERN RECOGNITION, 2025, 158
  • [4] Low-Light Object Detection Combining Transformer and Dynamic Feature Fusion
    Cai, Teng
    Chen, Cifa
    Dong, Fangmin
    Computer Engineering and Applications, 2024, 60 (09) : 135 - 141
  • [5] Lightweight two-stage transformer for low-light image enhancement and object detection
    Kou, Kangkang
    Yin, Xiangchen
    Gao, Xin
    Nie, Fuhui
    Liu, Jing
    Zhang, Guoying
    DIGITAL SIGNAL PROCESSING, 2024, 150
  • [6] LIELFormer: Low-Light Image Enhancement with a Lightweight Transformer
    Zhao, Wei
    Xie, Zhaoyang
    Huang, Lina
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 489 - 500
  • [7] Adaptive lightweight Transformer network for low-light image enhancement
    Meng, De
    Lei, Zhichun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (6-7) : 5365 - 5375
  • [8] LET: a local enhancement transformer for low-light image enhancement
    Pan, Lei
    Tian, Jun
    Zheng, Yuan
    Fu, Qiang
    Zhao, Zhiqing
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [9] Low-light images enhancement via a dense transformer network
    Huang, Yi
    Fu, Gui
    Ren, Wanchun
    Tu, Xiaoguang
    Feng, Ziliang
    Liu, Bokai
    Liu, Jianhua
    Zhou, Chao
    Liu, Yuang
    Zhang, Xiaoqiang
    DIGITAL SIGNAL PROCESSING, 2024, 148
  • [10] A Transformer Network Combing CBAM for Low-Light Image Enhancement
    Sun, Zhefeng
    Wang, Chen
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 5205 - 5220