A dual-channel network for cross-domain one-shot semantic segmentation via adversarial learning

被引:4
|
作者
Yang, Yong [1 ]
Chen, Qiong [1 ]
Liu, Qingfa [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
One-shot semantic segmentation; Cross-domain problem; Adversarial learning; Meta-learning;
D O I
10.1016/j.knosys.2023.110698
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of one-shot semantic segmentation is to classify all pixels in a query image with a labeled support sample. Its current approaches divide data into two disjoint parts, a training set and a testing set. When the training and testing data are from different domains, the migration of the trained model to the testing data for prediction tends to perform less efficiently. Therefore, through the introduction of a distribution alignment module, a new dual-channel network (DCNet) for one-shot segmentation is proposed in this paper. The purpose of this introduction is to alleviate the performance degradation caused by distribution differences between the datasets. Furthermore, a soft pseudo-mask based prototype refinement module with Gumbel-Softmax is designed to enhance the expressive ability of prototypes and improve segmentation performance. Experiments are made on four datasets with large distribution differences, proving that our approach outperforms the compared methods by a large margin.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Remember the Difference: Cross-Domain Few-Shot Semantic Segmentation via Meta-Memory Transfer
    Wang, Wenjian
    Duan, Lijuan
    Wang, Yuxi
    En, Qing
    Fan, Junsong
    Zhang, Zhaoxiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7055 - 7064
  • [32] Learning Imbalanced Semantic Segmentation through Cross-Domain Relations of Multi-Agent Generative Adversarial Networks
    Rezaei, Mina
    Yang, Haojin
    Meinel, Christoph
    MEDICAL IMAGING 2019: COMPUTER-AIDED DIAGNOSIS, 2019, 10950
  • [33] Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar
    Li, Peike
    Yu, Xin
    Yang, Yi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4449 - 4459
  • [34] Dual adversarial network for cross-domain open set fault diagnosis
    Zhao, Chao
    Shen, Weiming
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2022, 221
  • [35] Scheduled sampling for one-shot learning via matching network
    Zhang, Lingling
    Liu, Jun
    Luo, Minnan
    Chang, Xiaojun
    Zheng, Qinghua
    Hauptmann, Alexander C.
    PATTERN RECOGNITION, 2019, 96
  • [36] A Cross-Domain Coupling Network for Semantic Segmentation of Remote Sensing Images
    Li, Xin
    Xu, Feng
    Tao, Feifei
    Tong, Yao
    Gao, Hongmin
    Liu, Fan
    Chen, Ziqi
    Lyu, Xin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [37] Pixel-by-Pixel Cross-Domain Alignment for Few-Shot Semantic Segmentation
    Tavera, Antonio
    Cermelli, Fabio
    Masone, Carlo
    Caputo, Barbara
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1959 - 1968
  • [38] One-Shot Summary Prototypical Network Toward Accurate Unpaved Road Semantic Segmentation
    Wang, Yooseung
    Lee, Donghyuk
    Heo, Jiseong
    Park, Jihun
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1200 - 1204
  • [39] Unsupervised Domain Adaptation for the Semantic Segmentation of Remote Sensing Images via One-Shot Image-to-Image Translation
    Ismael, Sarmad F.
    Kayabol, Koray
    Aptoula, Erchan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [40] Analysis of Tracheobronchial Diverticula Based on Semantic Segmentation of CT Images via the Dual-Channel Attention Network
    Zhang, Maoyi
    Ding, Changqing
    Guo, Shuli
    FRONTIERS IN PUBLIC HEALTH, 2022, 9