Domain-invariant feature extraction and fusion for cross-domain person re-identification

被引:13
|
作者
Jia, Zhaoqian [1 ]
Li, Ye [1 ]
Tan, Zhuofu [1 ]
Wang, Wenchao [1 ]
Wang, Zhiguo [1 ]
Yin, Guangqiang [1 ]
机构
[1] UESTC, Qingshuihe Campus 2006,Xiyuan Ave,West Hi tech Zo, Chengdu, Sichuan, Peoples R China
来源
VISUAL COMPUTER | 2023年 / 39卷 / 03期
关键词
Person ReID; Cross-domain; Feature fusion; Domain-invariant feature extraction; ATTRIBUTE; MODEL;
D O I
10.1007/s00371-022-02398-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
There are notable style differences among person re-identification (ReID) datasets, such as brightness, tone, resolution, background, and clothing style, that result in serious challenges for cross-domain person ReID. Two methods are usually used to solve these problems. One is to remove style differences between datasets by applying specific modules, such as instance normalization (IN). However, this method will filter out large amounts of valuable information for ReID. The other is to use person attributes as auxiliary information, but this method does not deeply explore the relationship between attribute features and global features, resulting in underutilized attribute information. We propose the domain-invariant feature extraction and fusion (DFEF), which consists of the attention and style normalization (ASN) and the attribute feature extraction and fusion (AFEF). The ASN module integrates spatial and channel attention modules on the basis of the IN layer to effectively remove the style differences between datasets and recovers the filtered-out information, which is useful for ReID. The AFEF module includes the attribute branch and the feature fusion module. For the attribute branch, we embed the convolutional block attention module (CBAM) into the attribute branch and adopt the multi-label focal loss (MLFL) to improve the accuracy of attribute recognition. For the feature fusion module, we propose the dispersion reweighting strategy to explore the correlation between attribute features and global features. The proposed DFEF method achieves 30.1% and 35.0% mAP on Market-1501 -> DukeMTMC-reID and DukeMTMC-reID -> Market-1501, respectively.
引用
收藏
页码:1205 / 1216
页数:12
相关论文
共 50 条
  • [1] Domain-invariant feature extraction and fusion for cross-domain person re-identification
    Zhaoqian Jia
    Ye Li
    Zhuofu Tan
    Wenchao Wang
    Zhiguo Wang
    Guangqiang Yin
    The Visual Computer, 2023, 39 : 1205 - 1216
  • [2] Cross-Domain Person Re-Identification Based on Feature Fusion
    Luo, Xianjun
    Ouyang, Zhi
    Du, Nisuo
    Song, Jingkuan
    Wei, Qin
    IEEE ACCESS, 2021, 9 : 98327 - 98336
  • [3] Cross-Domain Person Re-Identification Based on Feature Fusion Invariance
    Zhang, Yushi
    Song, Heping
    Wei, Jiawei
    APPLIED SCIENCES-BASEL, 2024, 14 (11):
  • [4] Learning domain invariant and specific representation for cross-domain person re-identification
    Chong, Yanwen
    Peng, Chengwei
    Zhang, Chen
    Wang, Yujie
    Feng, Wenqiang
    Pan, Shaoming
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5219 - 5232
  • [5] Learning domain invariant and specific representation for cross-domain person re-identification
    Yanwen Chong
    Chengwei Peng
    Chen Zhang
    Yujie Wang
    Wenqiang Feng
    Shaoming Pan
    Applied Intelligence, 2021, 51 : 5219 - 5232
  • [6] Cross-domain person re-identification with normalized and enhanced feature
    Jia Z.
    Wang W.
    Li Y.
    Zeng Y.
    Wang Z.
    Yin G.
    Multimedia Tools and Applications, 2024, 83 (18) : 56077 - 56101
  • [7] Cross-domain Person Re-identification on Adaptive Fusion Network
    Guo Y.-C.
    Feng F.
    Yan G.
    Hao X.-K.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (11): : 2744 - 2756
  • [8] Adaptive Domain-Invariant Feature Extraction for Cross-Domain Linguistic Steganalysis
    Xue, Yiming
    Wu, Jiaxuan
    Ji, Ronghua
    Zhong, Ping
    Wen, Juan
    Peng, Wanli
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 920 - 933
  • [9] Attribute-Aligned Domain-Invariant Feature Learning for Unsupervised Domain Adaptation Person Re-Identification
    Li, Huafeng
    Chen, Yiwen
    Tao, Dapeng
    Yu, Zhengtao
    Qi, Guanqiu
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 1480 - 1494
  • [10] Generalizable Person Re-identification by Domain-Invariant Mapping Network
    Song, Jifei
    Yang, Yongxin
    Song, Yi-Zhe
    Xiang, Tao
    Hospedales, Timothy M.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 719 - 728