Image Semantic Segmentation Based on Multi-Scale Feature Extraction and Fully Connected Conditional Random Fields

被引:2
作者
Dong Yongfeng [1 ,2 ]
Yang Yuxin [1 ]
Wang Liqin [1 ,2 ]
机构
[1] Hebei Univ Technol, Sch Artificial Intelligence, Tianjin 300401, Peoples R China
[2] Hebei Prov Key Lab Big Data Comp, Tianjin 300401, Peoples R China
关键词
image processing; image semantic segmentation; Convolutional neural network; multi-scale feature; deep learning; fully connected conditional random field;
D O I
10.3788/LOP56.131007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Aiming at the problems of insufficient usage of context information and unclear image edge segmentation in image semantic segmentation, a network model based on multi-scale feature extraction and fully connected conditional random fields is proposed. RGH and depth images arc input into the network in a multi-scale form, and their features arc extracted by a Convolutional neural network. Depth information is added to supplement the RGH feature map and obtain a rough semantic segmentation, which is optimized by the fully connected conditional random fields. Finally, fine semantic segmentation results arc obtained. This proposed method improves the precision of semantic segmentation and optimizes the image edge segmentation, which has a practical application.
引用
收藏
页数:9
相关论文
共 26 条
[1]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.348
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]  
Chen L., 2018, Semantic image segmentation with deeplab in tensorflow
[4]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[5]   Semantic Segmentation of RGBD Images with Mutex Constraints [J].
Deng, Zhuo ;
Todorovic, Sinisa ;
Latecki, Longin Jan .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1733-1741
[6]   Image Semantic Segmentation Based on Convolutional Neural Network Feature and Improved Superpixel Matching [J].
Guo Chengcheng ;
Yu Fengqin ;
Chen Ying .
LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (08)
[7]   A review of semantic segmentation using deep neural networks [J].
Guo, Yanming ;
Liu, Yu ;
Georgiou, Theodoros ;
Lew, Michael S. .
INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2018, 7 (02) :87-93
[8]   Learning Rich Features from RGB-D Images for Object Detection and Segmentation [J].
Gupta, Saurabh ;
Girshick, Ross ;
Arbelaez, Pablo ;
Malik, Jitendra .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :345-360
[9]   Perceptual Organization and Recognition of Indoor Scenes from RGB-D Images [J].
Gupta, Saurabh ;
Arbelaez, Pablo ;
Malik, Jitendra .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :564-571
[10]   FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-Based CNN Architecture [J].
Hazirbas, Caner ;
Ma, Lingni ;
Domokos, Csaba ;
Cremers, Daniel .
COMPUTER VISION - ACCV 2016, PT I, 2017, 10111 :213-228