Indoor scene segmentation algorithm based on full convolutional neural network

被引:0
作者
Zijiang Zhu
Deming Li
Yi Hu
Junshan Li
Dong Liu
Jianjun Li
机构
[1] University of Foreign Studies,School of Information Science and Technology, South China Business College of Guangdong
[2] University of Foreign Studies,Institute of Intelligent Information Processing, South China Business College of Guangdong
[3] Guangxi Normal University,College of Physical Science and Technology
来源
Neural Computing and Applications | 2021年 / 33卷
关键词
Indoor scene; Convolutional neural network; Deep learning; Image segmentation;
D O I
暂无
中图分类号
学科分类号
摘要
With the leaps and bounds of computer performance and the advent of the era of big data, deep learning has drawn more and more attention from all walks of life. It can combine low-level features to form more abstract high-level features and describe the data more essentially. Therefore, it is widely used in various fields such as computer vision. Image segmentation is one of the most basic research topics in the field of computer vision. The main purpose is to extract regions of interest from images for later image processing research. In 3D reconstruction based on sequence images, the segmentation accuracy and speed of sequence images determine the quality and efficiency of target reconstruction. Therefore, when facing large-scale sequence images, the biggest problem is how to improve the segmentation speed while ensuring accuracy. Based on the above background, the research content of this article is an indoor scene segmentation algorithm based on full convolutional neural network. According to the characteristics of indoor application scenes, this paper proposes a fast convolutional neural network image segmentation method to segment the indoor scene image and construct the fast fully convolutional networks (FFCN) for indoor scene image segmentation uses inter-layer fusion to reduce the amount of network calculation parameters and avoid the loss of picture feature information by continuous convolution. In order to verify the effectiveness of the network, in this paper, a basic living object data set (XAUT data set) in an indoor environment is created. The XAUT data set is used to train the FFCN network under the Caffe framework to obtain an indoor scene segmentation model. In order to compare the effectiveness of the model, the structure of the worn FCN8s, FCN16s, and FCN32s models was fine-tuned, and the corresponding algorithm model for indoor scene segmentation was obtained by training with the XAUT data set. The experimental results show that the pixel recognition accuracy of all types of networks has reached 86%, and the mean IU ratio has reached more than 63%. The mean IU of the FCN8s network is the highest at 70.38%, but its segmentation speed is only 1/5 of FFCN. On the premise that other types of indicators are not much different, the average segmentation speed on FFCN fast segmentation convolutional neural network reaches 40 fps. It can be seen that the scale fusion technology can well avoid the loss of image feature information in the network convolution and reddening process. Compared with other FCN networks, it has a faster speed and is conducive to real-time image preprocessing.
引用
收藏
页码:8261 / 8273
页数:12
相关论文
共 70 条
[1]  
Dong X(2016)SubMarkov random walk for image segmentation IEEE Trans Image Process 25 516-527
[2]  
Shen J(2015)Multiple hypotheses image segmentation and classification with application to dietary assessment IEEE J Biomed Health Inf 19 377-388
[3]  
Shao L(2016)DeepLab: semantic Image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs IEEE Trans Pattern Anal Mach Intell 40 834-848
[4]  
Zhu F(2015)Beyond pixels: a comprehensive survey from bottom-up to semantic image segmentation and cosegmentation J Vis Commun Image Represent 34 12-27
[5]  
Bosch M(2015)Supervised evaluation of image segmentation and object proposal techniques IEEE Trans Pattern Anal Mach Intell 38 1-876
[6]  
Khanna N(2019)Self-organizing neural networks for image segmentation based on multiphase active contour Neural Comput Appl 31 865-786
[7]  
Chen LC(2015)Research on the texture image segmentation method based on Markov random field Chin J Sci Instrum 36 776-185
[8]  
Papandreou G(2015)Remote sensing image segmentation based on mean shift algorithm with adaptive bandwidth[J] Commun Comput Inf Sci 482 179-476
[9]  
Kokkinos I(2015)A comparison of stochastic optimization techniques for image segmentation Int J Intell Syst 15 441-3094
[10]  
Zhu H(2019)Figure-ground image segmentation using feature-based multi-objective genetic programming techniques Neural Comput Appl 31 3075-456