Combination of validity aggregation and multi-scale feature for person re-identification

被引:0
作者
Zhi-yong Huang
Wen-cheng Qin
Fen Luo
Tian-hui Guan
Fang Xie
Shu Han
Da-ming Sun
机构
[1] Chongqing University,School of Microelectronics and Communication Engineering
来源
Journal of Ambient Intelligence and Humanized Computing | 2023年 / 14卷
关键词
Deep learning; Person re-identification; Regional validity; Triplet loss; Validity aggregation;
D O I
暂无
中图分类号
学科分类号
摘要
Person re-identification (re-ID) gradually has attracted attention of the industry and academe. It has a great application future in computer vision with the development of deep learning. The main challenges in the process of studying re-ID come from different camera angles, occlusion, and person’s posture changes. How to extract a powerful person descriptor is a fundamental problem in re-ID task, which is still an open topic today. In this study, we propose a Validity aggregation and multi-scale feature extraction network (VMSFEN), based on global and local features to convey more interesting information. In order to tackle local feature misalignment and feature pairs contribution, a novel strategy that combines cross-alignment and validity aggregation strategy is embedded into our model. Cross-alignment aims to obtain the same semantic features according to max semantic features. Validity aggregation provides appropriate weight to each matched local feature pair. Finally, we integrate the learned feature pairs with calculated weight, and introduce it into the triplet loss function. The approach of this work achieves 96.3% Rank-1 and 88.6% mAP on Market1501, 89.9% Rank-1 and 80.3% mAP on the DukeMTMC-reID, 80.1% Rank-1 and 76.3% mAP on the CUHK03. These findings prove that VMSFEN is an efficient network in re-ID study.
引用
收藏
页码:3353 / 3368
页数:15
相关论文
共 99 条
  • [1] Borgia A(2018)Cross-view discriminative feature learning for person re-identification IEEE Trans Image Process 27 5338-5349
  • [2] Hua Y(2017)Person re-identification by deep learning multi-scale representations Proc IEEE Int Conf Comput vis Workshops 2017 2590-2600
  • [3] Kodirov E(2018)Person re-identification by camera correlation aware feature augmentation IEEE Trans Pattern Anal Mach Intell 40 392-408
  • [4] Robertson NM(2019)Deeply-learned spatial alignment for person re-identification IEEE Access 16 19-18
  • [5] Chen Y(2020)Adaptive exploration for unsupervised person re-identification ACM Trans Multimedia Comput Commun Appl 6 1-552
  • [6] Zhu X(2020)Occluded person re-identification based on feature fusion and sparse reconstruction Multimed Tools Appl 2007 545-35644
  • [7] Gong S(2007)Graph-based visual saliency Adv Neural Inf Process Syst 7 35631-890
  • [8] Chen YC(2019)Contribution-based multi-stream feature distance fusion method with k-distribution re-ranking for person re-identification IEEE Access 2016 875-1071
  • [9] Zhu X(2016)Scalable metric learning via weighted approximate rank component analysis Eur Conf Comput vis 2018 1062-2295
  • [10] Zheng WS(2018)Human semantic parsing for person re-identification Proc IEEE Conf Comput vis Pattern Recognit 2012 2288-1923