共 34 条
TIPCB: A simple but effective part-based convolutional baseline for text-based person search
被引:82
|作者:
Chen, Yuhao
[1
]
Zhang, Guoqing
[1
]
Lu, Yujiang
[1
]
Wang, Zhenxing
[2
]
Zheng, Yuhui
[1
]
机构:
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Math & Stat, Nanjing 210044, Peoples R China
来源:
基金:
中国国家自然科学基金;
关键词:
Cross-modality;
Person search;
Local representation;
NETWORK;
REIDENTIFICATION;
D O I:
10.1016/j.neucom.2022.04.081
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
Text-based person search is a sub-task in the field of image retrieval, which aims to retrieve target person images according to a given textual description. The significant feature gap between two modalities makes this task very challenging. Many existing methods attempt to utilize local alignment to address this problem in the fine-grained level. However, most relevant methods introduce additional models or complicated training and evaluation strategies, which are hard to use in realistic scenarios. In order to facilitate the practical application, we propose a simple but effective baseline for text-based person search named TIPCB (i.e., Text-Image Part-based Convolutional Baseline). Firstly, a novel dual-path local alignment network structure is proposed to extract visual and textual local representations, in which images are segmented horizontally and texts are aligned adaptively. Then, we propose a multi-stage cross-modal matching strategy, which eliminates the modality gap from three feature levels, including low level, local level and global level. Extensive experiments are conducted on the widely-used benchmark datasets (CUHK-PEDES and ICFG-PEDES) and verify that our method outperforms all the existing methods. Our code has been released in https://github.com/OrangeYHChen/TIPCB. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:171 / 181
页数:11
相关论文