A dual-channel network for cross-domain one-shot semantic segmentation via adversarial learning

被引:4
|
作者
Yang, Yong [1 ]
Chen, Qiong [1 ]
Liu, Qingfa [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
One-shot semantic segmentation; Cross-domain problem; Adversarial learning; Meta-learning;
D O I
10.1016/j.knosys.2023.110698
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of one-shot semantic segmentation is to classify all pixels in a query image with a labeled support sample. Its current approaches divide data into two disjoint parts, a training set and a testing set. When the training and testing data are from different domains, the migration of the trained model to the testing data for prediction tends to perform less efficiently. Therefore, through the introduction of a distribution alignment module, a new dual-channel network (DCNet) for one-shot segmentation is proposed in this paper. The purpose of this introduction is to alleviate the performance degradation caused by distribution differences between the datasets. Furthermore, a soft pseudo-mask based prototype refinement module with Gumbel-Softmax is designed to enhance the expressive ability of prototypes and improve segmentation performance. Experiments are made on four datasets with large distribution differences, proving that our approach outperforms the compared methods by a large margin.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Domain Adaptive Video Semantic Segmentation via Cross-Domain Moving Object Mixing
    Cho, Kyusik
    Lee, Suhyeon
    Seong, Hongje
    Kim, Euntai
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 489 - 498
  • [42] Adversarial learning with data selection for cross-domain histopathological breast Cancer segmentation
    Zhenrong Lin
    Jidong Li
    Qipeng Yao
    Haocheng Shen
    Lihang Wan
    Multimedia Tools and Applications, 2022, 81 : 5989 - 6008
  • [43] Cross-Domain Semantic Segmentation via Domain-Invariant Interactive Relation Transfer
    Lv, Fengmao
    Liang, Tao
    Chen, Xiang
    Lin, Guosheng
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4333 - 4342
  • [44] Adversarial learning with data selection for cross-domain histopathological breast Cancer segmentation
    Lin, Zhenrong
    Li, Jidong
    Yao, Qipeng
    Shen, Haocheng
    Wan, Lihang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 5989 - 6008
  • [45] Cross-domain few-shot fault diagnosis based on meta-learning and domain adversarial graph convolutional network
    Hu, Junwei
    Li, Weigang
    Zhang, Yong
    Tian, Zhiqiang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 136
  • [46] ATLRec: An Attentional Adversarial Transfer Learning Network for Cross-Domain Recommendation
    Ying Li
    Jia-Jie Xu
    Peng-Peng Zhao
    Jun-Hua Fang
    Wei Chen
    Lei Zhao
    Journal of Computer Science and Technology, 2020, 35 : 794 - 808
  • [47] Wi-Learner: Towards One-shot Learning for Cross-Domain Wi-Fi based Gesture Recognition
    Feng, Chao
    Wang, Nan
    Jiang, Yicheng
    Zheng, Xia
    Li, Kang
    Wang, Zheng
    Chen, Xiaojiang
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (03):
  • [48] ATLRec: An Attentional Adversarial Transfer Learning Network for Cross-Domain Recommendation
    Li, Ying
    Xu, Jia-Jie
    Zhao, Peng-Peng
    Fang, Jun-Hua
    Chen, Wei
    Zhao, Lei
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2020, 35 (04) : 794 - 808
  • [49] Style Mixing and Patchwise Prototypical Matching for One-Shot Unsupervised Domain Adaptive Semantic Segmentation
    Wu, Xinyi
    Wu, Zhenyao
    Lu, Yuhang
    Ju, Lili
    Wang, Song
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2740 - 2749
  • [50] StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learning
    Fu, Yuqian
    Xie, Yu
    Fu, Yanwei
    Jiang, Yu-Gang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 24575 - 24584