Domain-Incremental Semantic Segmentation for Traffic Scenes

被引:0
|
作者
Liu, Yazhou [1 ]
Chen, Haoqi [1 ]
Lasang, Pongsak [2 ]
Wu, Zheng
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Panason Res & Dev Ctr Singapore, Singapore 469332, Singapore
基金
中国国家自然科学基金;
关键词
Autonomous driving; semantic segmentation; multi-domain learning; Incremental learning; incremental learning; NETWORK; INFORMATION;
D O I
10.1109/TITS.2024.3525005
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Traffic scene segmentation is an important visual perception process to provide strong support for the decision-making of autonomous driving systems. The traffic scene is an open environment that is constantly changing, and the segmentation model needs to have the ability of domain incremental learning to maintain stable performance in the changing environment. The main challenges include the diversity of the traffic scene and the accumulation of forgetting about the previous traffic scenes. In this work, an adapter-based network model is proposed to solve the domain-incremental traffic scene segmentation task. Specifically, the domain-aware adapter (DAA) module is proposed, which divides the model parameters into domain-shared and domain-specific, so that the model can handle the information of all learned domains by dynamically expanding parameters. To further alleviate catastrophic forgetting, the inter-class correlation enhancement (ICE) module is proposed, which utilizes inter-class correlation to improve segmentation accuracy for single domain and knowledge transfer between domains. Extensive experimental results show that the proposed method can achieve promising results for retaining the competitive performance for both new and old domains.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Continual Learning for Class- and Domain-Incremental Semantic Segmentation
    Kalb, Tobias
    Roschani, Masoud
    Ruf, Miriam
    Beyerer, Juergen
    2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 1345 - 1351
  • [2] Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions
    Kalb, Tobias
    Beyerer, Juergen
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19508 - 19518
  • [3] Domain-Incremental Learning for Remote Sensing Semantic Segmentation With Multifeature Constraints in Graph Space
    Huang, Wubiao
    Ding, Mingtao
    Deng, Fei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] DILRS: Domain-Incremental Learning for Semantic Segmentation in Multi-Source Remote Sensing Data
    Rui, Xue
    Li, Ziqiang
    Cao, Yang
    Li, Ziyang
    Song, Weiguo
    REMOTE SENSING, 2023, 15 (10)
  • [5] Online Domain-Incremental Learning Approach to Classify Acoustic Scenes in All Locations
    Mulimani, Manjunath
    Mesaros, Annamaria
    32ND EUROPEAN SIGNAL PROCESSING CONFERENCE, EUSIPCO 2024, 2024, : 96 - 100
  • [6] Semantic Segmentation of Grey-Scale Traffic Scenes
    Le, Trung Khoa
    Klette, Reinhard
    IMAGE AND VIDEO TECHNOLOGY (PSIVT 2019), 2019, 11854 : 365 - 378
  • [7] Prompt-based Transceiver Cooperation for Semantic Communications with Domain-Incremental Background Knowledge
    Zhang, Lan
    Das, Madhureeta
    Sun, Yao
    Niyato, Dusit
    Yuan, Xiaoyong
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2087 - 2092
  • [8] Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
    Zhang, Yang
    David, Philip
    Gong, Boqing
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2039 - 2049
  • [9] Unsupervised Domain Adaptation for Semantic Segmentation of Urban Scenes
    Biasetton, Matteo
    Michieli, Umberto
    Agresti, Gianluca
    Zanuttigh, Pietro
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1211 - 1220
  • [10] Clustering-based Domain-Incremental Learning
    Lamers, Christiaan
    Vidal, Rene
    Belbachir, Nabil
    Van Stein, Niki
    Back, Thomas
    Giampouras, Paris
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 3376 - 3384