Attentive multi-granularity perception network for person search

被引:7
作者
Zhang, Qixian [1 ]
Wu, Jun [2 ]
Miao, Duoqian [1 ]
Zhao, Cairong
Zhang, Qi [1 ]
机构
[1] Tongji Univ, Dept Comp Sci & Technol, Shanghai 201804, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200438, Peoples R China
基金
中国国家自然科学基金;
关键词
Person search; Person re-identification; Multi-granularity; Feature mixer;
D O I
10.1016/j.ins.2024.121191
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Person search is an extremely challenging task that seeks to identify individuals through joint person detection and person re-identification from uncropped real scene images. Previous studies primarily focus on learning rich features to enhance identification. However, arbitrary feature enhancement strategies may introduce unwanted background noise. Moreover, different scenarios usually exhibit varying pedestrian appearances or even intricate occlusions, leading to inconsistent/incomplete pedestrian features in different images. In this paper, we introduce a novel Attentive Multi-granularity Perception (AMP) module seamlessly integrated into our AMPN network. This module specifically addresses appearance variations and occlusions within a person's Region of Interest (RoI). The AMP module harnesses discriminative relationship features from various local regions, significantly enhancing identification accuracy. It comprises two principal components: the Pedestrian Perception Enhancement (PPE) block and the Background Interference Suppressor (BIS). The PPE block introduces a Spatial-wise Feature Mixer and a Channel-wise Feature Mixer, which effectively capture and refine discriminative relation features. Simultaneously, the BIS operates in parallel with the PPE block, enriching the discriminative relation features and enhancing the distinctiveness between the foreground and background. Our AMP module is plug-and-play and can integrate with other person search models. Extensive experiments validate our model's merits, achieving state-of-the-art performance on CUHK-SYSU and a 4.8% mAP gain over SeqNet on PRW at a desirable speed. Our code is accessible at https:// github .com /zqx951102 /AMPN.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] PSTR: End-to-End One-Step Person Search With Transformers
    Cao, Jiale
    Pang, Yanwei
    Anwer, Rao Muhammad
    Cholakkal, Hisham
    Xie, Jin
    Shah, Mubarak
    Khan, Fahad Shahbaz
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9448 - 9457
  • [2] RCAA: Relational Context-Aware Agents for Person Search
    Chang, Xiaojun
    Huang, Po-Yao
    Shen, Yi-Dong
    Liang, Xiaodan
    Yang, Yi
    Hauptmann, Alexander G.
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 86 - 102
  • [3] Chen D, 2020, AAAI CONF ARTIF INTE, V34, P10518
  • [4] Person Search via a Mask-Guided Two-Stream CNN Model
    Chen, Di
    Zhang, Shanshan
    Ouyang, Wanli
    Yang, Jian
    Tai, Ying
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 764 - 781
  • [5] Norm-Aware Embedding for Efficient Person Search
    Chen, Di
    Zhang, Shanshan
    Yang, Jian
    Schiele, Bernt
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 12612 - 12621
  • [6] Instance Guided Proposal Network for Person Search
    Dong, Wenkai
    Zhang, Zhaoxiang
    Song, Chunfeng
    Tan, Tieniu
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2582 - 2591
  • [7] Dosovitskiy A., 2021, INT C LEARNING REPRE, DOI DOI 10.48550/ARXIV.2010.11929
  • [8] SAT: Scale-Augmented Transformer for Person Search
    Fiaz, Mustansar
    Cholakkal, Hisham
    Anwer, Rao Muhammad
    Khan, Fahad Shahbaz
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4809 - 4818
  • [9] End-to-End Trainable Trident Person Search Network Using Adaptive Gradient Propagation
    Han, Byeong-Ju
    Ko, Kuhyeun
    Sim, Jae-Young
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 905 - 913
  • [10] DMRNet plus plus : Learning Discriminative Features With Decoupled Networks and Enriched Pairs for One-Step Person Search
    Han, Chuchu
    Zheng, Zhedong
    Su, Kai
    Yu, Dongdong
    Yuan, Zehuan
    Gao, Changxin
    Sang, Nong
    Yang, Yi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7319 - 7337