Effective person re-identification by self-attention model guided feature learning

被引:28
作者
Li, Yang [1 ]
Jiang, Xiaoyan [1 ]
Hwang, Jenq-Neng [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, 333 Longteng Rd, Shanghai, Peoples R China
[2] Univ Washington, Dept Elect & Comp Engn, Box 352500, Seattle, WA 98195 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Feature extraction; Self-attention; Cross-entropy loss; Triplet loss;
D O I
10.1016/j.knosys.2019.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID), of which the goal is to recognize person identities of images captured by non-overlapping cameras, is a challenging topic in computer vision. Most existing person re-ID methods conduct directly on detected objects, which ignore the space misalignment caused by detectors, human pose variation, and occlusion problems. To tackle the above mentioned difficulties, we propose a self-attention model guided deep convolutional neural network(DCNN) to learn robust features from image shots. Kernels of the self-attention model evaluate weights for the importance of different person regions. To solve the local feature dependence problem of feature extraction, the non-local feature map generated by the self-attention model is fused with the original feature map generated from the resnet-50. Furthermore, the loss function considers both the cross-entropy loss and the triplet loss in the training process, which enables the network to capture common characteristics within the same individuals and significant differences between distinct persons. Extensive experiments and comparative evaluations show that our proposed strategy outperforms most of the state-of-the-art methods on standard datasets: Market-1501, DukeMTMC-relD, and CUHK03. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 48 条
  • [1] [Anonymous], ASS ADV ARTIFICIAL I
  • [2] [Anonymous], IEEE T IMAGE PROCESS
  • [3] [Anonymous], 2017, ARXIV PREPRINT ARXIV
  • [4] [Anonymous], 2017, Intell Autom Soft Comput, DOI DOI 10.1080/10798587.2016.1267245
  • [5] [Anonymous], PLANT SOIL
  • [6] Scalable Person Re-identification on Supervised Smoothed Manifold
    Bai, Song
    Bai, Xiang
    Tian, Qi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3356 - 3365
  • [7] An empirical comparison on state-of-the-art multi-class imbalance learning algorithms and a new diversified ensemble learning scheme
    Bi, Jingjun
    Zhang, Chongsheng
    [J]. KNOWLEDGE-BASED SYSTEMS, 2018, 158 : 81 - 93
  • [8] Similarity Learning with Spatial Constraints for Person Re-identification
    Chen, Dapeng
    Yuan, Zejian
    Chen, Badong
    Zheng, Nanning
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1268 - 1277
  • [9] Beyond triplet loss: a deep quadruplet network for person re-identification
    Chen, Weihua
    Chen, Xiaotang
    Zhang, Jianguo
    Huang, Kaiqi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1320 - 1329
  • [10] Person Re-Identification by Deep Learning Multi-Scale Representations
    Chen, Yanbei
    Zhu, Xiatian
    Gong, Shaogang
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2590 - 2600