Domain-invariant feature extraction and fusion for cross-domain person re-identification

被引:13
作者
Jia, Zhaoqian [1 ]
Li, Ye [1 ]
Tan, Zhuofu [1 ]
Wang, Wenchao [1 ]
Wang, Zhiguo [1 ]
Yin, Guangqiang [1 ]
机构
[1] UESTC, Qingshuihe Campus 2006,Xiyuan Ave,West Hi tech Zo, Chengdu, Sichuan, Peoples R China
关键词
Person ReID; Cross-domain; Feature fusion; Domain-invariant feature extraction; ATTRIBUTE; MODEL;
D O I
10.1007/s00371-022-02398-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
There are notable style differences among person re-identification (ReID) datasets, such as brightness, tone, resolution, background, and clothing style, that result in serious challenges for cross-domain person ReID. Two methods are usually used to solve these problems. One is to remove style differences between datasets by applying specific modules, such as instance normalization (IN). However, this method will filter out large amounts of valuable information for ReID. The other is to use person attributes as auxiliary information, but this method does not deeply explore the relationship between attribute features and global features, resulting in underutilized attribute information. We propose the domain-invariant feature extraction and fusion (DFEF), which consists of the attention and style normalization (ASN) and the attribute feature extraction and fusion (AFEF). The ASN module integrates spatial and channel attention modules on the basis of the IN layer to effectively remove the style differences between datasets and recovers the filtered-out information, which is useful for ReID. The AFEF module includes the attribute branch and the feature fusion module. For the attribute branch, we embed the convolutional block attention module (CBAM) into the attribute branch and adopt the multi-label focal loss (MLFL) to improve the accuracy of attribute recognition. For the feature fusion module, we propose the dispersion reweighting strategy to explore the correlation between attribute features and global features. The proposed DFEF method achieves 30.1% and 35.0% mAP on Market-1501 -> DukeMTMC-reID and DukeMTMC-reID -> Market-1501, respectively.
引用
收藏
页码:1205 / 1216
页数:12
相关论文
共 50 条
  • [21] Unsupervised Joint Subspace and Dictionary Learning for Enhanced Cross-Domain Person Re-Identification
    Qi, Lei
    Huo, Jing
    Fan, Xiaocong
    Shi, Yinghuan
    Gao, Yang
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2018, 12 (06) : 1263 - 1275
  • [22] Domain-Invariant Feature Progressive Distillation with Adversarial Adaptive Augmentation for Low-Resource Cross-Domain NER
    Zhang, Tao
    Xia, Congying
    Liu, Zhiwei
    Zhao, Shu
    Peng, Hao
    Yu, Philip
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (03)
  • [23] Cross-Modal Cross-Domain Dual Alignment Network for RGB-Infrared Person Re-Identification
    Fu, Xiaowei
    Huang, Fuxiang
    Zhou, Yuhang
    Ma, Huimin
    Xu, Xin
    Zhang, Lei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6874 - 6887
  • [24] A FEATURE FUSION STRATEGY FOR PERSON RE-IDENTIFICATION
    Gao, Mu
    Ai, Haizhou
    Bai, Bo
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 4274 - 4278
  • [25] Hierarchical Feature Fusion for Cross-Modality Person Re-identification
    Fu, Wen
    Lim, Monghao
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024, 38 (16)
  • [26] Domain Generalization and Feature Fusion for Cross-domain Imperceptible Adversarial Attack Detection
    Li, Yi
    Angelov, Plamen
    Suri, Neeraj
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [27] Cross-Domain Person Re-Identification Based on Multi-Branch Pose-Guided Occlusion Generation
    Liu, Pengnan
    Wang, Yanchen
    Li, Yunlong
    Cheng, Deqiang
    Xu, Feixiang
    SENSORS, 2025, 25 (02)
  • [28] Global and Part Feature Fusion for Cross-Modality Person Re-Identification
    Wang, Xianju
    Cordova, Ronald S.
    IEEE ACCESS, 2022, 10 : 122038 - 122046
  • [29] Feature Fusion and Ellipse Segmentation for Person Re-identification
    Qi, Meibin
    Zeng, Junxian
    Jiang, Jianguo
    Chen, Cuiqun
    PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT I, 2018, 11256 : 50 - 61
  • [30] Domain-Camera Adaptation for Unsupervised Person Re-Identification
    Tian, Jiajie
    Teng, Zhu
    Li, Yan
    Li, Rui
    Wu, Yi
    Fan, Jianping
    2019 6TH INTERNATIONAL CONFERENCE ON BEHAVIORAL, ECONOMIC AND SOCIO-CULTURAL COMPUTING (BESC 2019), 2019,