Multi-Similarity Enhancement Network for Few-Shot Segmentation

被引:2
作者
Chen, Hao [1 ]
Lu, Zhe-Ming [1 ]
Zheng, Yang-Ming [1 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
关键词
Few-shot semantic; few-shot learning; semantic segmentation; AGGREGATION;
D O I
10.1109/ACCESS.2023.3295893
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-Shot Segmentation (FSS) is challenging for intra-class diversity and support sample scarcity. Many works focus on the class-wise or pixel-wise similarity between the support foreground and query sample while neglecting the support background, which is vital for FSS to suppress the related query background. In this paper, we propose a Multi-Similarity Enhancement Network (MSENet) to remedy this issue by extracting the pixel-wise support-query similarity of the foreground and background. To remedy the shift issue, caused by the huge difference between support and query target objects, this study extracts and fuses multiple support-query similarity, and keep enhancing them with convolutional operations. Experimental results reveal that our approach achieves a performance of 66.8% in PASCAL and 43.8% in COCO, surpassing the state-of-the-art (SOTA) and outperforming other leading competitors.
引用
收藏
页码:73521 / 73530
页数:10
相关论文
共 58 条
  • [1] Enhancing Metric-Based Few-Shot Classification With Weighted Large Margin Nearest Center Loss
    Bao, Wei
    Huang, Meiyu
    Xiang, Xueshuang
    [J]. IEEE ACCESS, 2021, 9 : 90805 - 90815
  • [2] Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?
    Boudiaf, Malik
    Kervadec, Hoel
    Masud, Ziko Imtiaz
    Piantanida, Pablo
    Ben Ayed, Ismail
    Dolz, Jose
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13974 - 13983
  • [3] Meta-Seg: A Generalized Meta-Learning Framework for Multi-Class Few-Shot Semantic Segmentation
    Cao, Zhiying
    Zhang, Tengfei
    Diao, Wenhui
    Zhang, Yue
    Lyu, Xiaode
    Fu, Kun
    Sun, Xian
    [J]. IEEE ACCESS, 2019, 7 : 166109 - 166121
  • [4] Chen H, 2023, Arxiv, DOI arXiv:2303.06304
  • [5] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [6] Cho S., 2021, Advances in Neural Information Processing Systems
  • [7] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [8] The Pascal Visual Object Classes (VOC) Challenge
    Everingham, Mark
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) : 303 - 338
  • [9] Fan Q., 2022, P COMP VIS 17 EUR C, P1
  • [10] A Survey on Vision Transformer
    Han, Kai
    Wang, Yunhe
    Chen, Hanting
    Chen, Xinghao
    Guo, Jianyuan
    Liu, Zhenhua
    Tang, Yehui
    Xiao, An
    Xu, Chunjing
    Xu, Yixing
    Yang, Zhaohui
    Zhang, Yiman
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 87 - 110