DFR-ST: Discriminative feature representation with spatio-temporal cues for vehicle re-identification

被引:11
|
作者
Tu, Jingzheng [1 ,2 ,3 ]
Chen, Cailian [1 ,2 ,3 ]
Huang, Xiaolin [1 ,2 ,3 ]
He, Jianping [1 ,2 ,3 ]
Guan, Xinping [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ China, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manage, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle re -identification; Computer vision; Deep learning; Attention mechanism; Video surveillance;
D O I
10.1016/j.patcog.2022.108887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification (re-ID) aims to discover and match the target vehicles from a gallery image set taken by different cameras on a wide range of road networks. It is crucial for lots of applications such as security surveillance and traffic management. The remarkably similar appearances of distinct vehicles and the significant changes in viewpoints and illumination conditions pose grand challenges to vehicle re-ID. Conventional solutions focus on designing global visual appearances without sufficient consideration of vehicles' spatio-temporal relationships in different images. This paper proposes a discriminative feature representation with spatio-temporal clues (DFR-ST) for vehicle re-ID. It is capable of building robust fea-tures in the embedding space by involving appearance and spatio-temporal information. The proposed DFR-ST constructs an appearance model for a multi-grained visual representation by a two-stream archi-tecture and a spatio-temporal metric to provide complementary information based on this multi-modal information. Experimental results on four public datasets demonstrate DFR-ST outperforms the state-of-the-art methods, which validates the effectiveness of the proposed method. (c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Spatio-temporal inductance-pattern recognition for vehicle re-identification
    Abdulhai, B
    Tabib, SM
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2003, 11 (3-4) : 223 - 239
  • [2] Spatio-Temporal Representation Factorization for Video-based Person Re-Identification
    Aich, Abhishek
    Zheng, Meng
    Karanam, Srikrishna
    Chen, Terrence
    Roy-Chowdhury, Amit K.
    Wu, Ziyan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 152 - 162
  • [3] A SPATIO-TEMPORAL APPEARANCE REPRESENTATION FOR VIDEO-BASED PEDESTRIAN RE-IDENTIFICATION
    Liu, Kan
    Ma, Bingpeng
    Zhang, Wei
    Huang, Rui
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3810 - 3818
  • [4] Vehicle Re-Identification with Spatio-Temporal Model Leveraging by Pose View Embedding
    Huang, Wenxin
    Zhong, Xian
    Jia, Xuemei
    Liu, Wenxuan
    Feng, Meng
    Wang, Zheng
    Satoh, Shin'ichi
    ELECTRONICS, 2022, 11 (09)
  • [5] A spatio-temporal covariance descriptor for person re-identification
    Hadjkacem, Bassem
    Ayedi, Walid
    Abid, Mohamed
    Snoussi, Hichem
    2015 15TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA), 2015, : 618 - 622
  • [6] Person Re-identification by Exploiting Spatio-Temporal Cues and Multi-view Metric Learning
    Chen, Jiaxin
    Wang, Yunhong
    Tang, Yuan Yan
    IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (07) : 998 - 1002
  • [7] Person Re-identification in Videos by Analyzing Spatio-temporal Tubes
    Sekh, Arif Ahmed
    Dogra, Debi Prosad
    Choi, Heeseung
    Chae, Seungho
    Kim, Ig-Jae
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (33-34) : 24537 - 24551
  • [8] Person Re-identification in Videos by Analyzing Spatio-temporal Tubes
    Arif Ahmed Sekh
    Debi Prosad Dogra
    Heeseung Choi
    Seungho Chae
    Ig-Jae Kim
    Multimedia Tools and Applications, 2020, 79 : 24537 - 24551
  • [9] Deep Spatio-temporal Network for Accurate Person Re-identification
    Quan Nguyen Hong
    Nghia Nguyen Tuan
    Trung Tran Quang
    Dung Nguyen Tien
    Cuong Vo Le
    2017 PROCEEDINGS OF KICS-IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATIONS WITH SAMSUNG LTE & 5G SPECIAL WORKSHOP, 2017, : 208 - 213
  • [10] An Improved Cross-Camera Vehicle Tracking Method: Re-Identification Feature Matching of Confidence Based on Spatio-Temporal Information
    Yu, Zhijia
    Xiang, Liangru
    Hu, Jianming
    Pei, Xin
    CICTP 2021: ADVANCED TRANSPORTATION, ENHANCED CONNECTION, 2021, : 430 - 439