Multi-Branch Feature Alignment Network for Misaligned and Occluded Person Re-Identification

被引:0
|
作者
Lyu, Chunyan [1 ]
Huang, Hai [1 ]
Zhang, Lixi [2 ]
Zhu, Wenting [2 ]
Wang, Zhengyang [3 ]
Wang, Kejun [3 ,4 ]
Jiao, Caidong [2 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Peoples R China
[2] Zhejiang Fangyuan Elect Equipment Testing Co Ltd, Jiaxing 314001, Peoples R China
[3] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[4] Beijing Inst Technol Zhuhai, Sch Informat Technol, Zhuhai 519088, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Pedestrians; Semantics; Wrist; Torso; Surveillance; Pose estimation; Legged locomotion; Hip; Identification of persons; Pixel; Person re-identification; feature alignment; feature-weighted fusion; pixel level;
D O I
10.1109/ACCESS.2024.3492312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As a pivotal computer vision technique, person re-identification (re-ID) assumes a paramount role in bolstering public security. During the process of computing feature similarities among person images, misaligned and occluded body parts may impede accurate identity retrieval. To mitigate these challenges, we introduce a Multi-Branch Feature Alignment Network (MBFA) comprising three distinct deep neural network branches. Primarily, the global feature branch is tailored to extract comprehensive features. Subsequently, the pose alignment branch is formulated to acquire segmented features via a specific feature-weighted fusion strategy. Finally, the semantic alignment branch is devised to derive high-order semantic features at a pixel level, enabling precise localization of visible parts in occluded pedestrians and focusing similarity computations on these regions. The integration of multi-scale feature information synergistically complements one another, resulting in feature alignment that augments the robustness and discrimination capabilities of the entire network. Consequently, MBFA adeptly mitigates the interferences caused by misalignment and occlusion. Across three prominent re-ID datasets and an occluded re-ID dataset, experimental results unequivocally affirm the superiority of our proposed methodology over existing state-of-the-art methods.
引用
收藏
页码:175445 / 175457
页数:13
相关论文
共 50 条
  • [21] Improved Occluded Person Re-Identification with Multi-feature Fusion
    Yang, Jing
    Zhang, Canlong
    Li, Zhixin
    Tang, Yanping
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT IV, 2021, 12894 : 308 - 319
  • [22] Region Generation and Assessment Network for Occluded Person Re-Identification
    He, Shuting
    Chen, Weihua
    Wang, Kai
    Luo, Hao
    Wang, Fan
    Jiang, Wei
    Ding, Henghui
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 120 - 132
  • [23] Learning discriminative and generalizable features with multi-branch for person re-identification
    Cheng, Ru
    Wang, Lukun
    Wei, Mingrun
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (06) : 5987 - 6001
  • [24] Multi-Branch Person Re-Identification Basedon Multi-Scale Attention
    Cong, Li
    Min, Jiang
    Jun, Kong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (20)
  • [25] MULTI BRANCH SIAMESE NETWORK FOR PERSON RE-IDENTIFICATION
    Munir, Asad
    Martinel, Niki
    Micheloni, Christian
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2351 - 2355
  • [26] Occluded Person Re-Identification With Pose Estimation Correction and Feature Reconstruction
    Liu, Zhigang
    Wang, Qi
    Wang, Miao
    Zhao, Yijun
    IEEE ACCESS, 2023, 11 : 14906 - 14914
  • [27] UNSUPERVISED PERSON RE-IDENTIFICATION USING MULTI-BRANCH FEATURE COMPENSATION NETWORK AND LINK-BASED CLUSTER DISSIMILARITY METRIC
    Pan, Lin
    Qi, Gege
    Guo, Biao
    Zhu, Yuesheng
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 4302 - 4306
  • [28] Reasoning and Tuning: Graph Attention Network for Occluded Person Re-Identification
    Huang, Meiyan
    Hou, Chunping
    Yang, Qingyuan
    Wang, Zhipeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1568 - 1582
  • [29] Semantic-Aware Occlusion-Robust Network for Occluded Person Re-Identification
    Zhang, Xiaokang
    Yan, Yan
    Xue, Jing-Hao
    Hua, Yang
    Wang, Hanzi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (07) : 2764 - 2778
  • [30] Mask-guided discriminative feature network for occluded person re-identification
    Zhong, Fujin
    Wang, Yunhe
    Yu, Hong
    Hu, Jun
    Yang, Yan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 101