An Improved Image Semantic Segmentation Method Based on Superpixels and Conditional Random Fields

被引:34
作者
Zhao, Wei [1 ]
Fu, Yi [1 ]
Wei, Xiaosong [1 ]
Wang, Hai [2 ]
机构
[1] Xidian Univ, Key Lab Elect Equipment Struct Design, Minist Educ, Xian 710071, Shaanxi, Peoples R China
[2] Xidian Univ, Sch Aerosp Sci & Technol, Xian 710071, Shaanxi, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2018年 / 8卷 / 05期
关键词
image semantic segmentation; superpixels; conditional random fields; fully convolutional network;
D O I
10.3390/app8050837
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper proposed an improved image semantic segmentation method based on superpixels and conditional random fields (CRFs). The proposed method can take full advantage of the superpixel edge information and the constraint relationship among different pixels. First, we employ fully convolutional networks (FCN) to obtain pixel-level semantic features and utilize simple linear iterative clustering (SLIC) to generate superpixel-level region information, respectively. Then, the segmentation results of image boundaries are optimized by the fusion of the obtained pixel-level and superpixel-level results. Finally, we make full use of the color and position information of pixels to further improve the semantic segmentation accuracy using the pixel-level prediction capability of CRFs. In summary, this improved method has advantages both in terms of excellent feature extraction capability and good boundary adherence. Experimental results on both the PASCAL VOC 2012 dataset and the Cityscapes dataset show that the proposed method can achieve significant improvement of segmentation accuracy in comparison with the traditional FCN model.
引用
收藏
页数:17
相关论文
共 40 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 2015, CVPR WORKSH FUT DAT
[3]  
[Anonymous], 2011, ADV NEURAL INF PROCE
[4]  
[Anonymous], 2017, arXiv 2017 1704.06857
[5]  
[Anonymous], 2015, COMP VIS WINT WORKSH
[6]  
[Anonymous], 2014, PROC IEEE C COMPUTER
[7]  
Chen L., 2014, Comput. Sci., V4, P357
[8]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[9]   Attention to Scale: Scale-aware Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Yang, Yi ;
Wang, Jiang ;
Xu, Wei ;
Yuille, Alan L. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3640-3649
[10]  
Chen Liang-Chieh, 2017, C COMP VIS PATT REC