High-precision and real-time visual tracking algorithm based on the Siamese network for autonomous driving

被引:2
作者
Lyu, Pengfei [1 ]
Wei, Minxiang [1 ]
Wu, Yuwei [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Energy & Power Engn, Nanjing, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Mech & Elect Engn, Nanjing, Peoples R China
关键词
Visual object tracking; Siamese network; Deep learning; Autonomous driving; Attention mechanism; OBJECT TRACKING;
D O I
10.1007/s11760-022-02331-y
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual object tracking is often used to track obstacles in autonomous driving tasks. It requires real-time performance while dealing with target deformation and illumination changes. To solve the above problems, this paper proposes a high-precision and real-time visual tracking algorithm for autonomous driving based on the Siamese network. First, our tracker utilizes ensemble learning to fuse two feature extraction branches that are derived from the convolutional neural network. Then, the channel attention mechanism is added before concatenation to redistribute feature weights. Finally, a region proposal network is adopted to generate tracking bounding boxes. Extensive experiments demonstrate that compared with the state-of-the-art algorithms, the proposed method achieves satisfactory results on four benchmark datasets while maintaining a higher frame rate. Also, the qualitative analysis results on the KITTI dataset indicate that our method can meet the challenges in autonomous driving.
引用
收藏
页码:1235 / 1243
页数:9
相关论文
共 30 条
[21]   Scale Equivariance Improves Siamese Tracking [J].
Sosnovik, Ivan ;
Moskalev, Artem ;
Smeulders, Arnold .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :2764-2773
[22]   End-to-end representation learning for Correlation Filter based tracking [J].
Valmadre, Jack ;
Bertinetto, Luca ;
Henriques, Joao ;
Vedaldi, Andrea ;
Torr, Philip H. S. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5000-5008
[23]   Siam R-CNN: Visual Tracking by Re-Detection [J].
Voigtlaender, Paul ;
Luiten, Jonathon ;
Torr, Philip H. S. ;
Leibe, Bastian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6577-6587
[24]   Tracking by Instance Detection: A Meta-Learning Approach [J].
Wang, Guangting ;
Luo, Chong ;
Sun, Xiaoyan ;
Xiong, Zhiwei ;
Zeng, Wenjun .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6287-6296
[25]   Fast Online Object Tracking and Segmentation: A Unifying Approach [J].
Wang, Qiang ;
Zhang, Li ;
Bertinetto, Luca ;
Hu, Weiming ;
Torr, Philip H. S. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1328-1338
[26]   Object Tracking Benchmark [J].
Wu, Yi ;
Lim, Jongwoo ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) :1834-1848
[27]   Online Object Tracking: A Benchmark [J].
Wu, Yi ;
Lim, Jongwoo ;
Yang, Ming-Hsuan .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :2411-2418
[28]   Deeper and Wider Siamese Networks for Real-Time Visual Tracking [J].
Zhang, Zhipeng ;
Peng, Houwen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4586-4595
[29]   Learning to Track Objects from Unlabeled Videos [J].
Zheng, Jilai ;
Ma, Chao ;
Peng, Houwen ;
Yang, Xiaokang .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :13526-13535
[30]  
Zhu Z., 2018, 2018 IEEE International Magnetics Conference (INTERMAG), DOI 10.1109/INTMAG.2018.8508710