A dual-channel network for cross-domain one-shot semantic segmentation via adversarial learning

被引:4
|
作者
Yang, Yong [1 ]
Chen, Qiong [1 ]
Liu, Qingfa [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
One-shot semantic segmentation; Cross-domain problem; Adversarial learning; Meta-learning;
D O I
10.1016/j.knosys.2023.110698
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of one-shot semantic segmentation is to classify all pixels in a query image with a labeled support sample. Its current approaches divide data into two disjoint parts, a training set and a testing set. When the training and testing data are from different domains, the migration of the trained model to the testing data for prediction tends to perform less efficiently. Therefore, through the introduction of a distribution alignment module, a new dual-channel network (DCNet) for one-shot segmentation is proposed in this paper. The purpose of this introduction is to alleviate the performance degradation caused by distribution differences between the datasets. Furthermore, a soft pseudo-mask based prototype refinement module with Gumbel-Softmax is designed to enhance the expressive ability of prototypes and improve segmentation performance. Experiments are made on four datasets with large distribution differences, proving that our approach outperforms the compared methods by a large margin.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] One-Shot Generative Adversarial Learning for MRI Segmentation of Craniomaxillofacial Bony Structures
    Chen, Xu
    Lian, Chunfeng
    Wang, Li
    Deng, Hannah
    Fung, Steve H.
    Nie, Dong
    Thung, Kim-Han
    Yap, Pew-Thian
    Gateno, Jaime
    Xia, James J.
    Shen, Dinggang
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (03) : 787 - 796
  • [22] Prototype-Guided Multitask Adversarial Network for Cross-Domain LiDAR Point Clouds Semantic Segmentation
    Yuan, Zhimin
    Cheng, Ming
    Zeng, Wankang
    Su, Yanfei
    Liu, Weiquan
    Yu, Shangshu
    Wang, Cheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] One-Shot Face Recognition with Feature Rectification via Adversarial Learning
    Zhou, Jianli
    Chen, Jun
    Liang, Chao
    Chen, Jin
    MULTIMEDIA MODELING (MMM 2020), PT I, 2020, 11961 : 290 - 302
  • [24] Prototypical Bidirectional Adaptation and Learning for Cross-Domain Semantic Segmentation
    Ren, Qinghua
    Mao, Qirong
    Lu, Shijian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 501 - 513
  • [25] Learning Pseudo-Relations for Cross-domain Semantic Segmentation
    Zhao, Dong
    Wangc, Shuang
    Zang, Qi
    Quan, Dou
    Ye, Xiutiao
    Yang, Rui
    Jiao, Licheng
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 19134 - 19146
  • [26] Cross-domain few-shot semantic segmentation for the astronaut work environment
    Sun, Qingwei
    Chao, Jiangang
    Lin, Wanhong
    ADVANCES IN SPACE RESEARCH, 2024, 74 (11) : 5934 - 5949
  • [27] Two-Branch Attention Network via Efficient Semantic Coupling for One-Shot Learning
    Li, Jun
    Wang, Duorui
    Liu, Xianglong
    Shi, Zhiping
    Wang, Meng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 341 - 351
  • [28] Cross-Domain Few-Shot Classification via Adversarial Task Augmentation
    Wang, Haoqing
    Deng, Zhi-Hong
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1075 - 1081
  • [29] Cross-modal & Cross-domain Learning for Unsupervised LiDAR Semantic Segmentation
    Chen, Yiyang
    Zhao, Shanshan
    Ding, Changxing
    Tang, Liyao
    Wang, Chaoyue
    Tao, Dacheng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3866 - 3875
  • [30] Multi-Modal Self-Supervised Learning for Cross-Domain One-Shot Bearing Fault Diagnosis
    Chen, Xiaohan
    Xue, Yihao
    Huang, Mengjie
    Yang, Rui
    IFAC PAPERSONLINE, 2024, 58 (04): : 746 - 751