Recurrent matching networks of spatial alignment learning for person re-identification

被引:0
作者
Lan Lin
Dan Zhang
Xin Zheng
Mao Ye
Jiuxia Guo
机构
[1] University of Electronic Science and Technology of China,School of Computer Science and Engineering, Center for Robotics, Key Laboratory for NeuroInformation of Ministry of Education
[2] China West Normal University,undefined
[3] Civil Aviation Flight University of China,undefined
来源
Multimedia Tools and Applications | 2020年 / 79卷
关键词
Person re-identification; Uncontrolled spatial misalignment; Local correspondence; Multi-view learning;
D O I
暂无
中图分类号
学科分类号
摘要
Person re-identification (re-id) usually refers to matching people across disjoint camera views. Many existing methods focus on extracting discriminative features or learning distance metrics to make the intraclass distance smaller than interclass distances. These methods subconsciously assume that pedestrian images are well aligned. However, one major challenge in person re-id is the unconstrained spatial misalignment between image pairs due to view angle changes and pedestrian pose variations. To address this problem, in this paper, we propose Recurrent Matching Network of Spatial Alignment Learning (RMN-SAL) to simulate the human vision perception. Reinforcement learning is introduced to locate attention regions, since it provides a flexible learning strategy for sequential decision-making. A linear mapping is employed to convert the environment state into spatial constraint, comprising spatial alignment into feature learning. And recurrent models are used to extract information from a sequence of corresponding regions. Finally, person re-id is performed based on the global features and the features from the learned alignment regions. Our contributions are: 1) the recurrent matching network, which can subtly combine local feature learning and sequential spatial correspondence learning into an end-to-end framework; 2) the design of a location network, which is based on reinforcement learning and aims to learn task-specific sequential spatial correspondences for different image pairs through the local pairwise internal representation interactions. The proposed model is evaluated on three benchmarks, including Market-1501, DukeMTMC-reID and CUHK03, and achieves better performances than other methods.
引用
收藏
页码:33735 / 33755
页数:20
相关论文
共 107 条
  • [31] Zhu X(undefined)undefined undefined undefined undefined-undefined
  • [32] Wu F(undefined)undefined undefined undefined undefined-undefined
  • [33] Hu R(undefined)undefined undefined undefined undefined-undefined
  • [34] You X(undefined)undefined undefined undefined undefined-undefined
  • [35] Wang Y(undefined)undefined undefined undefined undefined-undefined
  • [36] Feng H(undefined)undefined undefined undefined undefined-undefined
  • [37] Yang JY(undefined)undefined undefined undefined undefined-undefined
  • [38] Kaelbling LP(undefined)undefined undefined undefined undefined-undefined
  • [39] Littman ML(undefined)undefined undefined undefined undefined-undefined
  • [40] Moore AW(undefined)undefined undefined undefined undefined-undefined