Discriminative Feature Learning With Co-Occurrence Attention Network for Vehicle ReID

被引:19
作者
Sheng, Hao [1 ,2 ,3 ]
Wang, Shuai [2 ,4 ]
Chen, Haobo [5 ]
Yang, Da [2 ,4 ]
Huang, Yang [5 ]
Shen, Jiahao
Ke, Wei [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Hangzhou 311115, Peoples R China
[3] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
[4] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[5] ByteDance, Beijing 100089, Peoples R China
关键词
Feature extraction; Task analysis; Videos; Representation learning; Pipelines; Image color analysis; Visualization; Vehicle re-identification; co-occurrence attention; discriminative learning; image representation;
D O I
10.1109/TCSVT.2023.3326375
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle Re-Identification (ReID) aims to find images of the same vehicle from different videos. It remains a challenging task in the video analysis field due to the huge appearance discrepancy of the same vehicle in cross-view matching and the subtle difference of different similar vehicles in same-view matching. In this paper, we propose a Co-occurrence Attention Net (CAN) to deal with these two challenges. Specifically, CAN consists of two branches, a main branch and an aware branch. The main branch is in charge of extracting global features that are consistent in most views. This feature encodes holistic information such as color and pose, however, it can not handle cross/same-view hard cases, as shown in Fig.1. Therefore, the aware branch is designed to focus on the local details and viewpoint information, which can become an important complement for those hard cases. Considering that the positions of local areas such as wheels and logos change with the viewpoint, Aware Attention Module is introduced to find the hidden relationship among local areas and seamlessly combine the viewpoint information simultaneously. Then, CAN is trained by a partition-and-reunion-based loss, which can narrow the intra-class distance and increase the inter-class distance. Further, an adaptive co-occurrence view emphasize strategy is adopted to fully utilize the learned features. Experimental results on three widely used datasets including VeRi-776, VehicleID and VERI-Wild demonstrate the effectiveness of our method and competitive performance with other state-of-the-art methods.
引用
收藏
页码:3510 / 3522
页数:13
相关论文
共 50 条
  • [31] A Discriminative Feature Representation Method Based on Cascaded Attention Network With Adversarial Strategy for Speech Emotion Recognition
    Liu, Yang
    Sun, Haoqin
    Guan, Wenbo
    Xia, Yuqi
    Li, Yongwei
    Unoki, Masashi
    Zhao, Zhen
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1063 - 1074
  • [32] Co-occurrence Object Detection of the Transmission Lines Based on the Cross-Domain Interactive Feature Enhancement
    Zhao, Lijuan
    Liu, Chang'an
    Qu, Hongquan
    IEEE TRANSACTIONS ON POWER DELIVERY, 2023, 38 (06) : 4443 - 4453
  • [33] PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection
    Jin Xie
    Yanwei Pang
    Hisham Cholakkal
    Rao Anwer
    Fahad Khan
    Ling Shao
    Science China Information Sciences, 2021, 64
  • [34] CSC-Net: Cross-Color Spatial Co-Occurrence Matrix Network for Detecting Synthesized Fake Images
    Qiao, Tong
    Chen, Yuxing
    Zhou, Xiaofei
    Shi, Ran
    Shao, Hang
    Shen, Kunye
    Luo, Xiangyang
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (01) : 369 - 379
  • [35] The Effect of Feature Selection on Gray Level Co-Occurrence Matrix (GLCM) for the Four Breast Cancer Classificaticis
    Mawarni, Marrisaeka
    Utaminingrum, Fitri
    Mahmudy, Wayan Firdaus
    JOURNAL OF BIOMIMETICS BIOMATERIALS AND BIOMEDICAL ENGINEERING, 2022, 55 : 168 - 179
  • [36] Multi-attention guided and feature enhancement network for vehicle re-identification
    Yu, Yang
    He, Kun
    Yan, Gang
    Cen, Shixin
    Li, Yang
    Yu, Ming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (01) : 673 - 690
  • [37] PSC-Net: learning part spatial co-occurrence for occluded pedestrian detection
    Xie, Jin
    Pang, Yanwei
    Cholakkal, Hisham
    Anwer, Rao
    Khan, Fahad
    Shao, Ling
    SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)
  • [38] TEXTURE FEATURE EXTRACTION OF STEEL STRIP SURFACE DEFECT BASED ON GRAY LEVEL CO-OCCURRENCE MATRIX
    Guo, Ying-Jun
    Sun, Zi-Jun
    Sun, He-Xu
    Song, Xue-Ling
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL. 1, 2015, : 217 - 221
  • [39] Brain image fusion-based tumour detection using grey level co-occurrence matrix Tamura feature extraction with backpropagation network classification
    Bhavani, R.
    Vasanth, K.
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8727 - 8744
  • [40] Feature extraction using dual-tree complex wavelet transform and gray level co-occurrence matrix
    Yang, Peng
    Yang, Guowei
    NEUROCOMPUTING, 2016, 197 : 212 - 220