Fine-grained adaptive contrastive learning for unsupervised feature extraction

被引:0
作者
Yin, Tianyi [1 ,2 ]
Wang, Jingwei [3 ]
Zhao, Yukai [2 ]
Wang, Han [2 ]
Ma, Yunlong [2 ]
Liu, Min [2 ]
机构
[1] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 201804, Peoples R China
[2] Tongji Univ, Coll Elect & Informat Engn, Shanghai 201804, Peoples R China
[3] Ant Grp, Shanghai 200122, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; BYOL; SimCLR; Fine-grained recognition; Cross-domain generalization; FUSION;
D O I
10.1016/j.neucom.2024.129014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Self-supervised contrastive learning (SCL) has emerged as a crucial technique for unsupervised fine-grained feature extraction in the deep learning field. However, model collapse is a prevalent issue that hinders the potential of this approach, particularly in fine-grained tasks. To address the performance degradation in SCL, we propose a novel framework called Fine-grained Adaptive Contrastive Learning (FACL), which consists of three carefully designed modules. The first module is the adaptive center-point regression, which empowers the segment anything model to extract regions of interest adaptively. The second module, Diffusion Gaussian Noise, creates proxy distributions for the original samples, thereby augmenting the data with increased diversity. Finally, the lightweight multi-scale instant extraction module improves the efficiency and accuracy of feature extraction by integrating multi-scale sensory fields. Extensive experiments on real-world datasets demonstrate the effectiveness of the FACL framework in various tasks, including biometric authentication and anomaly detection. FACL outperforms existing SCL methods, reducing the equal error rate up to 54.8% and 64.1% compared to SimCLR and BYOL, respectively.
引用
收藏
页数:13
相关论文
共 70 条
  • [1] Survey on Self-Supervised Learning: Auxiliary Pretext Tasks and Contrastive Learning Methods in Imaging
    Albelwi, Saleh
    [J]. ENTROPY, 2022, 24 (04)
  • [2] Fusion of Band Limited Phase Only Correlation and Width Centroid Contour Distance for finger based biometrics
    Asaari, Mohd Shahrinie Mohd
    Suandi, Shahrel A.
    Rosdi, Bakhtiar Affendi
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (07) : 3367 - 3382
  • [3] Bardes A, 2022, Arxiv, DOI [arXiv:2105.04906, DOI 10.48550/ARXIV.2105.04906]
  • [4] Beining Huang, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P1269, DOI 10.1109/ICPR.2010.316
  • [5] Caron M, 2020, ADV NEUR IN, V33
  • [6] Emerging Properties in Self-Supervised Vision Transformers
    Caron, Mathilde
    Touvron, Hugo
    Misra, Ishan
    Jegou, Herve
    Mairal, Julien
    Bojanowski, Piotr
    Joulin, Armand
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9630 - 9640
  • [7] Self-supervised graph representation learning via bootstrapping
    Che, Feihu
    Yang, Guohua
    Zhang, Dawei
    Tao, Jianhua
    Liu, Tong
    [J]. NEUROCOMPUTING, 2021, 456 (456) : 88 - 96
  • [8] Contrastive structure and texture fusion for image inpainting
    Chen, Long
    Yuan, Changan
    Qin, Xiao
    Sun, Wei
    Zhu, Xiaofeng
    [J]. NEUROCOMPUTING, 2023, 536 : 1 - 12
  • [9] Chen TS, 2018, Arxiv, DOI arXiv:1807.00505
  • [10] Chen T, 2020, PR MACH LEARN RES, V119