CeCR: Cross-entropy contrastive replay for online class-incremental continual learning

被引:4
|
作者
Sun, Guanglu [1 ]
Ji, Baolun [1 ]
Liang, Lili [1 ]
Chen, Minghui [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Peoples R China
关键词
Online class incremental learning; Catastrophic forgetting; Cross-entropy contrastive loss; Contrastive replay; Buffer management; NEURAL-NETWORKS; EFFICIENT;
D O I
10.1016/j.neunet.2024.106163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the realization of learning continually from an online data stream, replay -based methods have shown superior potential. The main challenge of replay -based methods is the selection of representative samples which are stored in the buffer and replayed. In this paper, we propose the Cross -entropy Contrastive Replay (CeCR) method in the online class -incremental setting. First, we present the Class -focused Memory Retrieval method that proceeds the class -level sampling without replacement. Second, we put forward the class -mean approximation memory update method that selectively replaces the mistakenly classified training samples with samples of current input batch. In addition, the Cross -entropy Contrastive Loss is proposed to implement the model training with obtaining more solid knowledge to achieve effective learning. Experiments show that the CeCR method has comparable or improved performance in two benchmark datasets in comparison with the state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] BEFM: A balanced and efficient fine-tuning model in class-incremental learning
    Liu, Lize
    Ji, Jian
    Zhao, Lei
    KNOWLEDGE-BASED SYSTEMS, 2025, 315
  • [42] No One Left Behind: Real-World Federated Class-Incremental Learning
    Dong, Jiahua
    Li, Hongliu
    Cong, Yang
    Sun, Gan
    Zhang, Yulun
    Van Gool, Luc
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (04) : 2054 - 2070
  • [43] DSS: A Diverse Sample Selection Method to Preserve Knowledge in Class-Incremental Learning
    Nokhwal, Sahil
    Kumar, Nirman
    2023 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING & MACHINE INTELLIGENCE, ISCMI, 2023, : 178 - 182
  • [44] Class-Incremental Learning Method With Fast Update and High Retainability Based on Broad Learning System
    Du, Jie
    Liu, Peng
    Vong, Chi-Man
    Chen, Chuangquan
    Wang, Tianfu
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 11332 - 11345
  • [45] C-SRCIL: Complex-valued Class-Incremental Learning for Signal Recognition
    Fan, Zhaoyu
    Tu, Ya
    Shi, Qingjiang
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [46] Look At Me, No Replay! SurpriseNet: Anomaly Detection Inspired Class Incremental Learning
    Lee, Anton
    Zhang, Yaqian
    Gomes, Heitor Murilo
    Bifet, Albert
    Pfahringer, Bernhard
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 4038 - 4042
  • [47] Class-Incremental Learning Based on Feature Extraction of CNN with Optimized Softmax and One-Class Classifiers
    Ye, Xin
    Zhu, Qiuyu
    IEEE ACCESS, 2019, 7 : 42024 - 42031
  • [48] Class-Incremental Learning Network for Small Objects Enhancing of Semantic Segmentation in Aerial Imagery
    Li, Junxi
    Sun, Xian
    Diao, Wenhui
    Wang, Peijin
    Feng, Yingchao
    Lu, Xiaonan
    Xu, Guangluan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [49] Enhancing Class-Incremental Learning for Image Classification via Bidirectional Transport and Selective Momentum
    Fu, Feifei
    Gao, Yizhao
    Lu, Zhiwu
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 175 - 183
  • [50] Less confidence, less forgetting: Learning with a humbler teacher in exemplar-free Class-Incremental learning
    Gao, Zijian
    Xu, Kele
    Zhuang, Huiping
    Liu, Li
    Mao, Xinjun
    Ding, Bo
    Feng, Dawei
    Wang, Huaimin
    NEURAL NETWORKS, 2024, 179