CeCR: Cross-entropy contrastive replay for online class-incremental continual learning

被引:4
|
作者
Sun, Guanglu [1 ]
Ji, Baolun [1 ]
Liang, Lili [1 ]
Chen, Minghui [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Peoples R China
关键词
Online class incremental learning; Catastrophic forgetting; Cross-entropy contrastive loss; Contrastive replay; Buffer management; NEURAL-NETWORKS; EFFICIENT;
D O I
10.1016/j.neunet.2024.106163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the realization of learning continually from an online data stream, replay -based methods have shown superior potential. The main challenge of replay -based methods is the selection of representative samples which are stored in the buffer and replayed. In this paper, we propose the Cross -entropy Contrastive Replay (CeCR) method in the online class -incremental setting. First, we present the Class -focused Memory Retrieval method that proceeds the class -level sampling without replacement. Second, we put forward the class -mean approximation memory update method that selectively replaces the mistakenly classified training samples with samples of current input batch. In addition, the Cross -entropy Contrastive Loss is proposed to implement the model training with obtaining more solid knowledge to achieve effective learning. Experiments show that the CeCR method has comparable or improved performance in two benchmark datasets in comparison with the state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] A robust and anti-forgettiable model for class-incremental learning
    Chen, Jianting
    Xiang, Yang
    APPLIED INTELLIGENCE, 2023, 53 (11) : 14128 - 14145
  • [32] Prompt-based learning for few-shot class-incremental learning
    Yuan, Jicheng
    Chen, Hang
    Tian, Songsong
    Li, Wenfa
    Li, Lusi
    Ning, Enhao
    Zhang, Yugui
    ALEXANDRIA ENGINEERING JOURNAL, 2025, 120 : 287 - 295
  • [33] Adaptive adapter routing for long-tailed class-incremental learning
    Qi, Zhi-Hong
    Zhou, Da-Wei
    Yao, Yiran
    Ye, Han-Jia
    Zhan, De-Chuan
    MACHINE LEARNING, 2025, 114 (03)
  • [34] Rethinking Few-Shot Class-Incremental Learning: Learning from Yourself
    Tang, Yu-Ming
    Peng, Yi-Xing
    Meng, Jingke
    Zheng, Wei-Shi
    COMPUTER VISION - ECCV 2024, PT LXI, 2025, 15119 : 108 - 128
  • [35] KABI: Class-Incremental Learning via knowledge Amalgamation and Batch Identification
    Li, Caixia
    Xu, Wenhua
    Si, Xizhu
    Song, Ping
    2021 5TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE (ICIAI 2021), 2021, : 170 - 176
  • [36] GENERALIZABLE TWO-BRANCH FRAMEWORK FOR IMAGE CLASS-INCREMENTAL LEARNING
    Wu, Chao
    Chang, Xiaobin
    Wang, Ruixuan
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4265 - 4269
  • [37] FRMM: Feature Reprojection for Exemplar-Free Class-Incremental Learning
    Wang, Hao
    Chen, Jing
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024, 2024, 14864 : 251 - 263
  • [38] Few-Shot Class Incremental Learning with Generative Feature Replay
    Shankarampeta, Abhilash Reddy
    Yamauchi, Koichiro
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM), 2021, : 259 - 267
  • [39] Class Bias Correction Matters: A Class-Incremental Learning Framework for Remote Sensing Scene Classification
    Wei, Yunze
    Pan, Zongxu
    Wu, Yirong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [40] CBCL-PR: A Cognitively Inspired Model for Class-Incremental Learning in Robotics
    Ayub, Ali
    Wagner, Alan R.
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 2004 - 2013