TIPCB: A simple but effective part-based convolutional baseline for text-based person search

被引:82
|
作者
Chen, Yuhao [1 ]
Zhang, Guoqing [1 ]
Lu, Yujiang [1 ]
Wang, Zhenxing [2 ]
Zheng, Yuhui [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modality; Person search; Local representation; NETWORK; REIDENTIFICATION;
D O I
10.1016/j.neucom.2022.04.081
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text-based person search is a sub-task in the field of image retrieval, which aims to retrieve target person images according to a given textual description. The significant feature gap between two modalities makes this task very challenging. Many existing methods attempt to utilize local alignment to address this problem in the fine-grained level. However, most relevant methods introduce additional models or complicated training and evaluation strategies, which are hard to use in realistic scenarios. In order to facilitate the practical application, we propose a simple but effective baseline for text-based person search named TIPCB (i.e., Text-Image Part-based Convolutional Baseline). Firstly, a novel dual-path local alignment network structure is proposed to extract visual and textual local representations, in which images are segmented horizontally and texts are aligned adaptively. Then, we propose a multi-stage cross-modal matching strategy, which eliminates the modality gap from three feature levels, including low level, local level and global level. Extensive experiments are conducted on the widely-used benchmark datasets (CUHK-PEDES and ICFG-PEDES) and verify that our method outperforms all the existing methods. Our code has been released in https://github.com/OrangeYHChen/TIPCB. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:171 / 181
页数:11
相关论文
共 34 条
  • [31] EESSO: Exploiting Extreme and Smooth Signals via Omni-frequency learning for Text-based Person Retrieval
    Xue, Jingyi
    Wang, Zijie
    Dong, Guan-Nan
    Zhu, Aichun
    IMAGE AND VISION COMPUTING, 2024, 142
  • [32] Multi-level cross-modality learning framework for text-based person re-identification
    Wu, Tinghui
    Zhang, Shuhe
    Chen, Dihu
    Hu, Haifeng
    ELECTRONICS LETTERS, 2023, 59 (20)
  • [33] Text-to-Image Person Re-Identification Based on Multimodal Graph Convolutional Network
    Han, Guang
    Lin, Min
    Li, Ziyang
    Zhao, Haitao
    Kwong, Sam
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6025 - 6036
  • [34] Transformer-based neural architecture search for effective visible-infrared person re-identification
    Sarker, Prodip Kumar
    NEUROCOMPUTING, 2025, 620