Unsupervised Joint Contrastive Learning for Aerial Person Re-Identification and Remote Sensing Image Classification

被引:0
作者
Zhang, Guoqing [1 ,2 ,3 ]
Li, Jiqiang [1 ]
Ye, Zhonglin [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp Sci, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Engn Res Ctr Digital Forens, Minist Educ, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Dept Jiangsu Collaborat Innovat, Nanjing 210044, Peoples R China
[4] Qinghai Normal Univ, State Key Lab Tibetan Intelligent Informat Proc &, Xining 810000, Peoples R China
基金
中国国家自然科学基金;
关键词
person re-identification; contrastive learning; unsupervised learning; remote sensing;
D O I
10.3390/rs16020422
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Unsupervised person re-identification (Re-ID) aims to match the query image of a person with images in the gallery without the use of supervision labels. Most existing methods usually generate pseudo-labels through clustering algorithms for contrastive learning, which inevitably results in noisy labels assigned to samples. In addition, methods that only apply contrastive learning at the clustering level fail to fully consider instance-level relationships between instances. Motivated by this, we propose a joint contrastive learning (JCL) framework for unsupervised person Re-ID. Our proposed method involves creating two memory banks to store features of cluster centroids and instances and applies cluster and instance-level contrastive learning, respectively, to jointly optimize the neural networks. The cluster-level contrastive loss is used to promote feature compactness within the same cluster and reinforce identity similarity. The instance-level contrastive loss is used to distinguish easily confused samples. In addition, we use a WaveBlock attention module (WAM), which can continuously wave feature map blocks and introduce attention mechanisms to produce more robust feature representations of a person without considerable information loss. Furthermore, we enhance the quality of our clustering by leveraging camera label information to eliminate clusters containing single camera captures. Extensive experimental results on two widely used person Re-ID datasets verify the effectiveness of our JCL method. Meanwhile, we also used two remote sensing datasets to demonstrate the generalizability of our method.
引用
收藏
页数:20
相关论文
共 54 条
[21]  
Ioffe Sergey, 2015, Proceedings of Machine Learning Research, V37, P448, DOI [10.48550/arXiv.1502.03167, DOI 10.48550/ARXIV.1502.03167]
[22]   Joint Visual and Temporal Consistency for Unsupervised Domain Adaptive Person Re-identification [J].
Li, Jianing ;
Zhang, Shiliang .
COMPUTER VISION - ECCV 2020, PT XXIV, 2020, 12369 :483-499
[23]   Cluster-Guided Asymmetric Contrastive Learning for Unsupervised Person Re-Identification [J].
Li, Mingkun ;
Li, Chun-Guang ;
Guo, Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :3606-3617
[24]  
Li ZY, 2022, AAAI CONF ARTIF INTE, P1527
[25]  
Lin YT, 2019, AAAI CONF ARTIF INTE, P8738
[26]   Unsupervised Person Re-Identification With Stochastic Training Strategy [J].
Liu, Tianyang ;
Lin, Yutian ;
Du, Bo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :4240-4250
[27]   Unsupervised Deep Hyperspectral Video Target Tracking and High Spectral-Spatial-Temporal Resolution (H3 Benchmark Dataset [J].
Liu, Zhenqi ;
Zhong, Yanfei ;
Wang, Xinyu ;
Shu, Meng ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[28]   Performance Measures and a Data Set for Multi-target, Multi-camera Tracking [J].
Ristani, Ergys ;
Solera, Francesco ;
Zou, Roger ;
Cucchiara, Rita ;
Tomasi, Carlo .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :17-35
[29]  
Sun H., 2021, P AS C PATT REC, P532
[30]   Self-Supervised Remote Sensing Feature Learning: Learning Paradigms, Challenges, and Future Works [J].
Tao, Chao ;
Qi, Ji ;
Guo, Mingning ;
Zhu, Qing ;
Li, Haifeng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61