Discriminative Feature Learning With Co-Occurrence Attention Network for Vehicle ReID

被引:19
作者
Sheng, Hao [1 ,2 ,3 ]
Wang, Shuai [2 ,4 ]
Chen, Haobo [5 ]
Yang, Da [2 ,4 ]
Huang, Yang [5 ]
Shen, Jiahao
Ke, Wei [3 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] Beihang Univ, Zhongfa Aviat Inst, Hangzhou 311115, Peoples R China
[3] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
[4] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[5] ByteDance, Beijing 100089, Peoples R China
关键词
Feature extraction; Task analysis; Videos; Representation learning; Pipelines; Image color analysis; Visualization; Vehicle re-identification; co-occurrence attention; discriminative learning; image representation;
D O I
10.1109/TCSVT.2023.3326375
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vehicle Re-Identification (ReID) aims to find images of the same vehicle from different videos. It remains a challenging task in the video analysis field due to the huge appearance discrepancy of the same vehicle in cross-view matching and the subtle difference of different similar vehicles in same-view matching. In this paper, we propose a Co-occurrence Attention Net (CAN) to deal with these two challenges. Specifically, CAN consists of two branches, a main branch and an aware branch. The main branch is in charge of extracting global features that are consistent in most views. This feature encodes holistic information such as color and pose, however, it can not handle cross/same-view hard cases, as shown in Fig.1. Therefore, the aware branch is designed to focus on the local details and viewpoint information, which can become an important complement for those hard cases. Considering that the positions of local areas such as wheels and logos change with the viewpoint, Aware Attention Module is introduced to find the hidden relationship among local areas and seamlessly combine the viewpoint information simultaneously. Then, CAN is trained by a partition-and-reunion-based loss, which can narrow the intra-class distance and increase the inter-class distance. Further, an adaptive co-occurrence view emphasize strategy is adopted to fully utilize the learned features. Experimental results on three widely used datasets including VeRi-776, VehicleID and VERI-Wild demonstrate the effectiveness of our method and competitive performance with other state-of-the-art methods.
引用
收藏
页码:3510 / 3522
页数:13
相关论文
共 50 条
  • [41] Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm
    Di Wu
    Ruixin Yang
    Chao Shen
    Journal of Intelligent Information Systems, 2021, 56 : 1 - 23
  • [42] Label Co-Occurrence Learning With Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification
    Chen, Bingzhi
    Li, Jinxing
    Lu, Guangming
    Yu, Hongbing
    Zhang, David
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (08) : 2292 - 2302
  • [43] Sentiment word co-occurrence and knowledge pair feature extraction based LDA short text clustering algorithm
    Wu, Di
    Yang, Ruixin
    Shen, Chao
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2021, 56 (01) : 1 - 23
  • [44] Disentangled Feature Learning Network and a Comprehensive Benchmark for Vehicle Re-Identification
    Bai, Yan
    Liu, Jun
    Lou, Yihang
    Wang, Ce
    Duan, Ling-yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6854 - 6871
  • [45] A Multi-Feature Learning Model with Enhanced Local Attention for Vehicle Re-Identification
    Sun, Wei
    Chen, Xuan
    Zhang, Xiaorui
    Dai, Guangzhao
    Chang, Pengshuai
    He, Xiaozheng
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 69 (03): : 3549 - 3561
  • [46] Diverse Feature Learning Network With Attention Suppression and Part Level Background Suppression for Person Re-Identification
    Yang, Shengrong
    Liu, Weihong
    Yu, Yangbin
    Hu, Haifeng
    Chen, Dihu
    Su, Tao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 283 - 297
  • [47] Texture feature extraction of hyper-spectral image with three-dimensional gray-level co-occurrence
    Wang, Shuang
    Hu, Bingliang
    Wang, Feng
    Journal of Information and Computational Science, 2015, 12 (04): : 1439 - 1448
  • [48] Data extraction of the gray level Co-occurrence matrix (GLCM) Feature on the fingerprints of parents and children in Lombok Island, Indonesia
    Bakti, Lalu Darmawan
    Imran, Bahtiar
    Wahyudi, Erfan
    Arwidiyarti, Dwinita
    Suryadi, Emi
    Multazam, Muhammad
    Maspaeni
    DATA IN BRIEF, 2021, 36
  • [49] TBE-Net: A Three-Branch Embedding Network With Part-Aware Ability and Feature Complementary Learning for Vehicle Re-Identification
    Sun, Wei
    Dai, Guangzhao
    Zhang, Xiaorui
    He, Xiaozheng
    Chen, Xuan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 14557 - 14569
  • [50] A new feature extraction approach based on one dimensional gray level co-occurrence matrices for bearing fault classification
    Kaya, Yilmaz
    Kuncan, Melih
    Kaplan, Kaplan
    Minaz, Mehmet Recep
    Ertunc, H. Metin
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2021, 33 (01) : 161 - 178