CeCR: Cross-entropy contrastive replay for online class-incremental continual learning

被引:4
|
作者
Sun, Guanglu [1 ]
Ji, Baolun [1 ]
Liang, Lili [1 ]
Chen, Minghui [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Comp Sci & Technol, Harbin 150080, Peoples R China
关键词
Online class incremental learning; Catastrophic forgetting; Cross-entropy contrastive loss; Contrastive replay; Buffer management; NEURAL-NETWORKS; EFFICIENT;
D O I
10.1016/j.neunet.2024.106163
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the realization of learning continually from an online data stream, replay -based methods have shown superior potential. The main challenge of replay -based methods is the selection of representative samples which are stored in the buffer and replayed. In this paper, we propose the Cross -entropy Contrastive Replay (CeCR) method in the online class -incremental setting. First, we present the Class -focused Memory Retrieval method that proceeds the class -level sampling without replacement. Second, we put forward the class -mean approximation memory update method that selectively replaces the mistakenly classified training samples with samples of current input batch. In addition, the Cross -entropy Contrastive Loss is proposed to implement the model training with obtaining more solid knowledge to achieve effective learning. Experiments show that the CeCR method has comparable or improved performance in two benchmark datasets in comparison with the state-of-the-art methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] A Class-Incremental Learning Method for PCB Defect Detection
    Ge, Quanbo
    Wu, Ruilin
    Wu, Yupei
    Liu, Huaping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [22] Deep Class-Incremental Learning From Decentralized Data
    Zhang, Xiaohan
    Dong, Songlin
    Chen, Jinjie
    Tian, Qi
    Gong, Yihong
    Hong, Xiaopeng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (05) : 7190 - 7203
  • [23] Mixup-Inspired Video Class-Incremental Learning
    Long, Jinqiang
    Gao, Yizhao
    Lu, Zhiwu
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1181 - 1186
  • [24] Class-Incremental Learning for Wireless Device Identification in IoT
    Liu, Yongxin
    Wang, Jian
    Li, Jianqiang
    Niu, Shuteng
    Song, Houbing
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (23) : 17227 - 17235
  • [25] Memory Efficient Class-Incremental Learning for Image Classification
    Zhao, Hanbin
    Wang, Hui
    Fu, Yongjian
    Wu, Fei
    Li, Xi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5966 - 5977
  • [26] Few-Shot Class-Incremental Learning for Classification and Object Detection: A Survey
    Zhang, Jinghua
    Liu, Li
    Silven, Olli
    Pietikainen, Matti
    Hu, Dewen
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) : 2924 - 2945
  • [27] A class-incremental learning approach for learning feature-compatible embeddings
    An, Hongchao
    Yang, Jing
    Zhang, Xiuhua
    Ruan, Xiaoli
    Wu, Yuankai
    Li, Shaobo
    Hu, Jianjun
    NEURAL NETWORKS, 2024, 180
  • [28] Class-Incremental Learning for Recognition of Complex-Valued Signals
    Fan, Zhaoyu
    Tu, Ya
    Lin, Yun
    Shi, Qingjiang
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (02) : 417 - 428
  • [29] CLASS-INCREMENTAL LEARNING FOR MULTI-LABEL AUDIO CLASSIFICATION
    Mulimani, Manjunath
    Mesaros, Annamaria
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 916 - 920
  • [30] A robust and anti-forgettiable model for class-incremental learning
    Jianting Chen
    Yang Xiang
    Applied Intelligence, 2023, 53 : 14128 - 14145