High-precision and real-time visual tracking algorithm based on the Siamese network for autonomous driving

被引:2
作者
Lyu, Pengfei [1 ]
Wei, Minxiang [1 ]
Wu, Yuwei [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Energy & Power Engn, Nanjing, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Mech & Elect Engn, Nanjing, Peoples R China
关键词
Visual object tracking; Siamese network; Deep learning; Autonomous driving; Attention mechanism; OBJECT TRACKING;
D O I
10.1007/s11760-022-02331-y
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual object tracking is often used to track obstacles in autonomous driving tasks. It requires real-time performance while dealing with target deformation and illumination changes. To solve the above problems, this paper proposes a high-precision and real-time visual tracking algorithm for autonomous driving based on the Siamese network. First, our tracker utilizes ensemble learning to fuse two feature extraction branches that are derived from the convolutional neural network. Then, the channel attention mechanism is added before concatenation to redistribute feature weights. Finally, a region proposal network is adopted to generate tracking bounding boxes. Extensive experiments demonstrate that compared with the state-of-the-art algorithms, the proposed method achieves satisfactory results on four benchmark datasets while maintaining a higher frame rate. Also, the qualitative analysis results on the KITTI dataset indicate that our method can meet the challenges in autonomous driving.
引用
收藏
页码:1235 / 1243
页数:9
相关论文
共 30 条
[11]  
Kristan M., 2016, EUROPEAN C COMPUTER, P1834
[12]   The Sixth Visual Object Tracking VOT2018 Challenge Results [J].
Kristan, Matej ;
Leonardis, Ales ;
Matas, Jiri ;
Felsberg, Michael ;
Pflugfelder, Roman ;
Zajc, Luka Cehovin ;
Vojir, Tomas ;
Bhat, Goutam ;
Lukezic, Alan ;
Eldesokey, Abdelrahman ;
Fernandez, Gustavo ;
Garcia-Martin, Alvaro ;
Iglesias-Arias, Alvaro ;
Alatan, A. Aydin ;
Gonzalez-Garcia, Abel ;
Petrosino, Alfredo ;
Memarmoghadam, Alireza ;
Vedaldi, Andrea ;
Muhic, Andrej ;
He, Anfeng ;
Smeulders, Arnold ;
Perera, Asanka G. ;
Li, Bo ;
Chen, Boyu ;
Kim, Changick ;
Xu, Changsheng ;
Xiong, Changzhen ;
Tian, Cheng ;
Luo, Chong ;
Sun, Chong ;
Hao, Cong ;
Kim, Daijin ;
Mishra, Deepak ;
Chen, Deming ;
Wang, Dong ;
Wee, Dongyoon ;
Gavves, Efstratios ;
Gundogdu, Erhan ;
Velasco-Salido, Erik ;
Khan, Fahad Shahbaz ;
Yang, Fan ;
Zhao, Fei ;
Li, Feng ;
Battistone, Francesco ;
De Ath, George ;
Subrahmanyam, Gorthi R. K. S. ;
Bastos, Guilherme ;
Ling, Haibin ;
Galoogahi, Hamed Kiani ;
Lee, Hankyeol .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I, 2019, 11129 :3-53
[13]   High Performance Visual Tracking with Siamese Region Proposal Network [J].
Li, Bo ;
Yan, Junjie ;
Wu, Wei ;
Zhu, Zheng ;
Hu, Xiaolin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8971-8980
[14]   Local Semantic Siamese Networks for Fast Tracking [J].
Liang, Zhiyuan ;
Shen, Jianbing .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3351-3364
[15]   Recursive fusion estimation for mobile robot localization under multiple energy harvesting sensors [J].
Lu, Yanyang ;
Karimi, Hamid Reza .
IET CONTROL THEORY AND APPLICATIONS, 2022, 16 (01) :20-30
[16]   Gaussian-response correlation filter for robust visual object tracking [J].
Moorthy, Sathishkumar ;
Choi, Jin Young ;
Joo, Young Hoon .
NEUROCOMPUTING, 2020, 411 :78-90
[17]   YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video [J].
Real, Esteban ;
Shlens, Jonathon ;
Mazzocchi, Stefano ;
Pan, Xin ;
Vanhoucke, Vincent .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :7464-7473
[18]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[19]   ImageNet Large Scale Visual Recognition Challenge [J].
Russakovsky, Olga ;
Deng, Jia ;
Su, Hao ;
Krause, Jonathan ;
Satheesh, Sanjeev ;
Ma, Sean ;
Huang, Zhiheng ;
Karpathy, Andrej ;
Khosla, Aditya ;
Bernstein, Michael ;
Berg, Alexander C. ;
Fei-Fei, Li .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :211-252
[20]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556