DFR-ST: Discriminative feature representation with spatio-temporal cues for vehicle re-identification

被引:13
作者
Tu, Jingzheng [1 ,2 ,3 ]
Chen, Cailian [1 ,2 ,3 ]
Huang, Xiaolin [1 ,2 ,3 ]
He, Jianping [1 ,2 ,3 ]
Guan, Xinping [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ China, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manage, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle re -identification; Computer vision; Deep learning; Attention mechanism; Video surveillance;
D O I
10.1016/j.patcog.2022.108887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification (re-ID) aims to discover and match the target vehicles from a gallery image set taken by different cameras on a wide range of road networks. It is crucial for lots of applications such as security surveillance and traffic management. The remarkably similar appearances of distinct vehicles and the significant changes in viewpoints and illumination conditions pose grand challenges to vehicle re-ID. Conventional solutions focus on designing global visual appearances without sufficient consideration of vehicles' spatio-temporal relationships in different images. This paper proposes a discriminative feature representation with spatio-temporal clues (DFR-ST) for vehicle re-ID. It is capable of building robust fea-tures in the embedding space by involving appearance and spatio-temporal information. The proposed DFR-ST constructs an appearance model for a multi-grained visual representation by a two-stream archi-tecture and a spatio-temporal metric to provide complementary information based on this multi-modal information. Experimental results on four public datasets demonstrate DFR-ST outperforms the state-of-the-art methods, which validates the effectiveness of the proposed method. (c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
[31]   Global-Local Discriminative Representation Learning Network for Viewpoint-Aware Vehicle Re-Identification in Intelligent Transportation [J].
Chen, Xiaobo ;
Yu, Haoze ;
Zhao, Feng ;
Hu, Yu ;
Li, Zuoyong .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[32]   Visual Features with Spatio-Temporal-Based Fusion Model for Cross-Dataset Vehicle Re-Identification [J].
Zakria ;
Deng, Jianhua ;
Cai, Jingye ;
Aftab, Muhammad Umar ;
Khokhar, Muhammad Saddam ;
Kumar, Rajesh .
ELECTRONICS, 2020, 9 (07) :1-20
[33]   Multi-scale and multi-branch feature representation for person re-identification [J].
Jiao, Shanshan ;
Pan, Zhisong ;
Hu, Guyu ;
Shen, Qing ;
Du, Lin ;
Chen, Yutian ;
Wang, Jiabao .
NEUROCOMPUTING, 2020, 414 :120-130
[34]   PFNet: Part-guided feature-combination network for vehicle re-identification [J].
Qian, Jiahe ;
Zhao, Jiandong .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (32) :78641-78658
[35]   Efficient and Deep Vehicle Re-Identification Using Multi-Level Feature Extraction [J].
Zakria ;
Cai, Jingye ;
Deng, Jianhua ;
Aftab, Muhammad Umar ;
Khokhar, Muhammad Saddam ;
Kumar, Rajesh .
APPLIED SCIENCES-BASEL, 2019, 9 (07)
[36]   UnbiasNet: Vehicle Re-Identification Oriented Unbiased Feature Enhancement by Using Causal Effect [J].
Huang, Junhao ;
Deng, Yuhui ;
Wang, Ke ;
Li, Zhangwei ;
Tang, Zhimin ;
Ding, Weiping .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) :1925-1937
[37]   OERFF: A Vehicle Re-Identification Method Based on Orientation Estimation and Regional Feature Fusion [J].
Zheng, Bin ;
Lei, Zhengbao ;
Tang, Chen ;
Wang, Jin ;
Liao, Zhoufan ;
Yu, Zhiyi ;
Xie, Yiming .
IEEE ACCESS, 2021, 9 (09) :66661-66674
[38]   PERSON RE-IDENTIFICATION WITH DEEP DENSE FEATURE REPRESENTATION AND JOINT BAYESIAN [J].
Wang, Shengke ;
Duan, Lianghua ;
Yang, Na ;
Dong, Junyu .
2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, :3560-3564
[39]   MULTI-SCALE DEEP FEATURE FUSION FOR VEHICLE RE-IDENTIFICATION [J].
Cheng, Yiting ;
Zhang, Chuanfa ;
Gu, Kangzheng ;
Qi, Lizhe ;
Gan, Zhongxue ;
Zhang, Wenqiang .
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, :1928-1932
[40]   Joint Image and Feature Levels Disentanglement for Generalizable Vehicle Re-identification [J].
Kuang, Zhenyu ;
He, Chuchu ;
Huang, Yue ;
Ding, Xinghao ;
Li, Huafeng .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (12) :15259-15273