Multi-Similarity Enhancement Network for Few-Shot Segmentation

被引:2
作者
Chen, Hao [1 ]
Lu, Zhe-Ming [1 ]
Zheng, Yang-Ming [1 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
关键词
Few-shot semantic; few-shot learning; semantic segmentation; AGGREGATION;
D O I
10.1109/ACCESS.2023.3295893
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-Shot Segmentation (FSS) is challenging for intra-class diversity and support sample scarcity. Many works focus on the class-wise or pixel-wise similarity between the support foreground and query sample while neglecting the support background, which is vital for FSS to suppress the related query background. In this paper, we propose a Multi-Similarity Enhancement Network (MSENet) to remedy this issue by extracting the pixel-wise support-query similarity of the foreground and background. To remedy the shift issue, caused by the huge difference between support and query target objects, this study extracts and fuses multiple support-query similarity, and keep enhancing them with convolutional operations. Experimental results reveal that our approach achieves a performance of 66.8% in PASCAL and 43.8% in COCO, surpassing the state-of-the-art (SOTA) and outperforming other leading competitors.
引用
收藏
页码:73521 / 73530
页数:10
相关论文
共 58 条
[31]   Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformer [J].
Lu, Zhihe ;
He, Sen ;
Zhu, Xiatian ;
Zhang, Li ;
Song, Yi-Zhe ;
Xiang, Tao .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :8721-8730
[32]   Hypercorrelation Squeeze for Few-Shot Segmenation [J].
Min, Juhong ;
Kang, Dahyun ;
Cho, Minsu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :6921-6932
[33]  
Munkhdalai T, 2018, PR MACH LEARN RES, V80
[34]  
Munkhdalai T, 2017, PR MACH LEARN RES, V70
[35]  
Ravigopal S. R., 2021, PROC IEEE INT S MED, P1
[36]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[37]  
Shaban A., 2017, BRIT MACHINE VISION, P1, DOI 10.5244/C.31.167
[38]   Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation [J].
Shi, Xinyu ;
Wei, Dong ;
Zhang, Yu ;
Lu, Donghuan ;
Ning, Munan ;
Chen, Jiashun ;
Ma, Kai ;
Zheng, Yefeng .
COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 :151-168
[39]   Active Instance Selection for Few-Shot Classification [J].
Shin, Junsup ;
Kang, Youngwook ;
Jung, Seungjin ;
Choi, Jongwon .
IEEE ACCESS, 2022, 10 :133186-133195
[40]  
Snell J, 2017, ADV NEUR IN, V30