A SIMILARITY DISTILLATION GUIDED FEATURE REFINEMENT NETWORK FOR FEW-SHOT SEMANTIC SEGMENTATION

被引:1
作者
Lyu, Shuchang [1 ]
Liu, Binghao [1 ]
Chen, Lijiang [1 ]
Zhao, Qi [1 ]
机构
[1] Beihang Univ, Dept Elect & Informat Engn, Beijing 100191, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
基金
中国国家自然科学基金;
关键词
Feature consistency; knowledge distillation; feature refinement; few-shot semantic segmentation;
D O I
10.1109/ICIP46576.2022.9897434
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot semantic segmentation is a challenging task of predicting object categories in pixel-wise with only few annotated samples. Existing methods mainly have two problems, which are representation inconsistency of query and support images and semantic-level feature insufficient. To tackle the two problems, we propose a similarity distillation guided feature refinement network (SD-FRNet). Specifically, we first use support label to generate support similarity feature map and coarse prediction of query image. Then, we use this coarse prediction to generate query similarity feature. To compensate feature representation inconsistency, we conduct knowledge distillation mechanism to align similarity features of query and support images. To enrich semantic-level feature, we further design a feature refinement module, which achieves high-quality segmentation. Extensive experiments show the effectiveness of SD-FRNet. On benchmark datasets, PASCAL-5(i) and COCO-20(i), our proposed SD-FRNet outperform the previous SOTA (state-of-the-art) results.
引用
收藏
页码:666 / 670
页数:5
相关论文
共 22 条
[1]   ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learning [J].
Chen, Chaofan ;
Yang, Xiaoshan ;
Xu, Changsheng ;
Huang, Xuhui ;
Ma, Zhe .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6592-6601
[2]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[3]  
Finn C, 2017, PR MACH LEARN RES, V70
[4]  
Garcia V., 2018, P ICLR
[5]   Feature Weighting and Boosting for Few-Shot Segmentation [J].
Khoi Nguyen ;
Todorovic, Sinisa .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :622-631
[6]  
Koch G., 2015, ICML DEEP LEARN WORK, V2
[7]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[8]   LEARNING WITH MEMORY FOR FEW-SHOT SEMANTIC SEGMENTATION [J].
Lu, Hongchao ;
Wei, Chao ;
Deng, Zhidong .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :629-633
[9]   GRAPH AFFINITY NETWORK FOR FEW-SHOT SEGMENTATION [J].
Luo, Xiaoliu ;
Zhang, Taiping .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :609-613
[10]  
Ma YQ, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P804