Cross-domain few-shot semantic segmentation for the astronaut work environment

被引:0
|
作者
Sun, Qingwei [1 ,2 ]
Chao, Jiangang [2 ,3 ]
Lin, Wanhong [2 ,3 ]
机构
[1] Space Engn Univ, Dept Aerosp Sci & Technol, Beijing 101416, Peoples R China
[2] China Astronaut Res & Training Ctr, Beijing 100094, Peoples R China
[3] China Astronaut Res & Training Ctr, Natl Key Lab Human Factors Engn, Beijing 100094, Peoples R China
关键词
Few-shot semantic segmentation; Cross-domain; Astronaut training;
D O I
10.1016/j.asr.2024.08.069
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The study of few-shot semantic segmentation (FSS) for the astronaut work environment (AWE) is of significant importance as it enables the segmentation of unknown categories. However, general FSS methods are predicated on the assumption that the training and testing data belong to the same domain. When this assumption is invalid, the model's performance is significantly degraded. We propose a more general approach, whereby the model is trained on a generic dataset and tested on a dedicated AWE dataset. This challenging task is referred to as cross-domain few-shot semantic segmentation (CD-FSS). A novel model, namely FTDCNet, is proposed, which comprises a domain-agnostic feature transformation module and a domain-constrained transformer. The FTDCNet model demonstrates superior performance compared to the state-of-the-art (SOTA) model, with an accuracy improvement of 11.83% and 11.42% under 1-shot and 5-shot settings, respectively. (c) 2024 COSPAR. Published by Elsevier B.V. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页码:5934 / 5949
页数:16
相关论文
共 50 条
  • [21] A broader study of cross-domain few-shot object detection
    Liangbing Sa
    Chongchong Yu
    Zhaorui Hong
    Tong Zheng
    Sihan Liu
    Applied Intelligence, 2023, 53 : 29465 - 29485
  • [22] Spectral Decomposition and Transformation for Cross-domain Few-shot Learning
    Liu, Yicong
    Zou, Yixiong
    Li, Ruixuan
    Li, Yuhua
    NEURAL NETWORKS, 2024, 179
  • [23] Generalized Few-shot Semantic Segmentation
    Tian, Zhuotao
    Lai, Xin
    Jiang, Li
    Liu, Shu
    Shu, Michelle
    Zhao, Hengshuang
    Jia, Jiaya
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11553 - 11562
  • [24] Relevance equilibrium network for cross-domain few-shot learning
    Ji, Zhong
    Kong, Xiangyu
    Wang, Xuan
    Liu, Xiyao
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2024, 13 (02)
  • [25] Experiments in cross-domain few-shot learning for image classification
    Wang, Hongyu
    Gouk, Henry
    Fraser, Huon
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2023, 53 (01) : 169 - 191
  • [26] Cross-domain few-shot action recognition with unlabeled videos
    Wang, Xiang
    Zhang, Shiwei
    Qing, Zhiwu
    Lv, Yiliang
    Gao, Changxin
    Sang, Nong
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
  • [27] Adversarial Feature Augmentation for Cross-domain Few-Shot Classification
    Hu, Yanxu
    Ma, Andy J.
    COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 20 - 37
  • [28] Feature extractor stacking for cross-domain few-shot learning
    Hongyu Wang
    Eibe Frank
    Bernhard Pfahringer
    Michael Mayo
    Geoffrey Holmes
    Machine Learning, 2024, 113 : 121 - 158
  • [29] Spatial-Spectral-Semantic Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Cao, Mengxin
    Zhang, Xu
    Cheng, Jinyong
    Zhao, Guixin
    Li, Wei
    Dong, Xiangjun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [30] FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON CROSS-DOMAIN SPECTRAL SEMANTIC RELATION TRANSFORMER
    Cao, Mengxin
    Zhao, Guixin
    Dong, Aimei
    Lv, Guohua
    Guo, Ying
    Dong, Xiangjun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1375 - 1379