Improved Occluded Person Re-Identification with Multi-feature Fusion

被引:1
作者
Yang, Jing [1 ]
Zhang, Canlong [1 ]
Li, Zhixin [1 ]
Tang, Yanping [2 ]
机构
[1] Guangxi Normal Univ, Guangxi Key Lab Multisource Informat Min & Secur, Guilin 541004, Peoples R China
[2] Guilin Univ Elect Technol, Sch Comp Sci & Informat Secur, Guilin 541004, Peoples R China
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT IV | 2021年 / 12894卷
基金
中国国家自然科学基金;
关键词
Attention mechanism; Pose estimation; Feature fusion; Person re-identification;
D O I
10.1007/978-3-030-86380-7_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pedestrians are often occluded by various obstacles in public places, which is a big challenge for person re-identification. To address this issue, we propose an improved occluded person re-Identification with the feature fusion network. The new network integrates spatial attention and pose estimation (SAPE) to learn representative, robust, and discriminative features. Specifically, the spatial attention mechanism anchors the regions of interest to the unoccluded spatial semantic information. It digs out the visual knowledge that is helpful for recognition from the global structural pattern. Then, we explicitly partition the attention-ware global feature into parts and improve the recognition granularity by matching local features. On this basis, we improve a pose estimation model to extract the information of the key points and feature fusion with the attention-aware feature to eliminate the influence of occlusion on the re-identification result. We test and verify the effectiveness of the SAPE on Occluded-REID, Occluded-DukeMTMC and Partial-REID. The experiment results show that the proposed method has achieved competitive performance to the state-of-the-art.
引用
收藏
页码:308 / 319
页数:12
相关论文
共 23 条
[11]   Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics [J].
Kendall, Alex ;
Gal, Yarin ;
Cipolla, Roberto .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7482-7491
[12]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[13]   Pose Transferrable Person Re-Identification [J].
Liu, Jinxian ;
Ni, Bingbing ;
Yan, Yichao ;
Zhou, Peng ;
Cheng, Shuo ;
Hu, Jianguo .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4099-4108
[14]   Pose-Guided Feature Alignment for Occluded Person Re-Identification [J].
Miao, Jiaxu ;
Wu, Yu ;
Liu, Ping ;
Ding, Yuhang ;
Yang, Yi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :542-551
[15]   A Pose-Sensitive Embedding for Person Re-Identification with Expanded Cross Neighborhood Re-Ranking [J].
Sarfraz, M. Saquib ;
Schumann, Arne ;
Eberle, Andreas ;
Stiefelhagen, Rainer .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :420-429
[16]   End-to-end training of CNN ensembles for person re-identification [J].
Serbetci, Ayse ;
Akgul, Yusuf Sinan .
PATTERN RECOGNITION, 2020, 104
[17]   Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline) [J].
Sun, Yifan ;
Zheng, Liang ;
Yang, Yi ;
Tian, Qi ;
Wang, Shengjin .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :501-518
[18]   AANet: Attribute Attention Network for Person Re-Identifications [J].
Tay, Chiat-Pin ;
Roy, Sharmili ;
Yap, Kim-Hui .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7127-7136
[19]   High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification [J].
Wang, Guan'an ;
Yang, Shuo ;
Liu, Huanyu ;
Wang, Zhicheng ;
Yang, Yang ;
Wang, Shuliang ;
Yu, Gang ;
Zhou, Erjin ;
Sun, Jian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6448-6457
[20]   Densely Semantically Aligned Person Re-Identification [J].
Zhang, Zhizheng ;
Lan, Cuiling ;
Zeng, Wenjun ;
Chen, Zhibo .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :667-676