DFR-ST: Discriminative feature representation with spatio-temporal cues for vehicle re-identification

被引:13
作者
Tu, Jingzheng [1 ,2 ,3 ]
Chen, Cailian [1 ,2 ,3 ]
Huang, Xiaolin [1 ,2 ,3 ]
He, Jianping [1 ,2 ,3 ]
Guan, Xinping [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ China, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manage, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle re -identification; Computer vision; Deep learning; Attention mechanism; Video surveillance;
D O I
10.1016/j.patcog.2022.108887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification (re-ID) aims to discover and match the target vehicles from a gallery image set taken by different cameras on a wide range of road networks. It is crucial for lots of applications such as security surveillance and traffic management. The remarkably similar appearances of distinct vehicles and the significant changes in viewpoints and illumination conditions pose grand challenges to vehicle re-ID. Conventional solutions focus on designing global visual appearances without sufficient consideration of vehicles' spatio-temporal relationships in different images. This paper proposes a discriminative feature representation with spatio-temporal clues (DFR-ST) for vehicle re-ID. It is capable of building robust fea-tures in the embedding space by involving appearance and spatio-temporal information. The proposed DFR-ST constructs an appearance model for a multi-grained visual representation by a two-stream archi-tecture and a spatio-temporal metric to provide complementary information based on this multi-modal information. Experimental results on four public datasets demonstrate DFR-ST outperforms the state-of-the-art methods, which validates the effectiveness of the proposed method. (c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
[21]   T-MAN: a neural ensemble approach for person re-identification using spatio-temporal information [J].
Tagore, Nirbhay Kumar ;
Chattopadhyay, Pratik ;
Wang, Lipo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (37-38) :28393-28409
[22]   STCA: Utilizing a spatio-temporal cross-attention network for enhancing video person re-identification [J].
Bhuiyan, Amran ;
Huang, Jimmy Xiangji .
IMAGE AND VISION COMPUTING, 2022, 123
[23]   T-MAN: a neural ensemble approach for person re-identification using spatio-temporal information [J].
Nirbhay Kumar Tagore ;
Pratik Chattopadhyay ;
Lipo Wang .
Multimedia Tools and Applications, 2020, 79 :28393-28409
[24]   Transfer Learning of Spatio-Temporal Information using 3D-CNN for Person Re-identification [J].
Kansal, Kajal ;
Subramanyam, A. V. .
2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, :923-928
[25]   VehicleNet: Learning Robust Visual Representation for Vehicle Re-Identification [J].
Zheng, Zhedong ;
Ruan, Tao ;
Wei, Yunchao ;
Yang, Yi ;
Mei, Tao .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) :2683-2693
[26]   Local Feature-Aware Siamese Matching Model for Vehicle Re-Identification [J].
Wang, Honglie ;
Sun, Shouqian ;
Zhou, Lunan ;
Guo, Lilin ;
Min, Xin ;
Li, Chao .
APPLIED SCIENCES-BASEL, 2020, 10 (07)
[27]   Vehicle Re-Identification Based on Dual Attention and Exact Feature Distribution Matching [J].
Xu, Yan ;
Pan, Xuguang ;
Guo, Xiaoyan ;
Liu, Xianglan .
Computer Engineering and Applications, 2023, 59 (23) :114-124
[28]   Multi-attention guided and feature enhancement network for vehicle re-identification [J].
Yu, Yang ;
He, Kun ;
Yan, Gang ;
Cen, Shixin ;
Li, Yang ;
Yu, Ming .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (01) :673-690
[29]   Progressive Discriminative Feature Learning for Visible-Infrared Person Re-Identification [J].
Zhou, Feng ;
Cheng, Zhuxuan ;
Yang, Haitao ;
Song, Yifeng ;
Fu, Shengpeng .
ELECTRONICS, 2024, 13 (14)
[30]   Vehicle Re-identification with a Pose-Aware Discriminative Part Learning Model [J].
Sun, Ya ;
Lu, Jianfeng ;
Li, Minxian ;
Ren, Gang ;
Ma, Jingfeng .
PATTERN RECOGNITION AND COMPUTER VISION, PT XIII, PRCV 2024, 2025, 15043 :251-265