Image semantic segmentation with hierarchical feature fusion based on deep neural network

被引:20
作者
Yang, Dawei [1 ]
Du, Yan [2 ]
Yao, Hongli [1 ]
Bao, Liyan [1 ]
机构
[1] Shenyang Ligong Univ, Sch Informat Sci & Engn, Shenyang 110159, Peoples R China
[2] Shenyang Ligong Univ, Ctr Modern Educ & Informat Technol, Shenyang, Peoples R China
关键词
Deep neural networks (DNN); feature extraction; feature fusion; image semantic segmentation;
D O I
10.1080/09540091.2022.2082384
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the field of image segmentation in industrial production. When using depth neural network to extract features from image information. Deep neural network can not effectively use the feature information between different levels. The accuracy of image semantic segmentation is damaged. To solve this problem, we present an image semantic segmentation with hierarchical feature fusion based on deep neural network (ISHF). It can be widely used in image perception and recognition of various living and industrial backgrounds. This algorithm uses convolution structure to extract the shallow low-level features with pixel level and the deep semantic features with image level, fully obtaining the hidden feature information in the shallow low-level features and deep semantic features. Then, after thinning the shallow low-level feature information by up-sampling operation, all feature information is merged and fused. Finally, the image semantic segmentation of hierarchical feature fusion is realised. Experimental results shows that our proposed method not only get better performance of image semantic segmentation, but also achieve faster running speed than SegNet, PSPNet, and DeepLabV3.
引用
收藏
页码:1772 / 1784
页数:13
相关论文
共 33 条
[1]  
[Anonymous], 2015, P IEEE C COMP VIS PA
[2]  
Boykov YY, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P105, DOI 10.1109/ICCV.2001.937505
[3]  
Chen L.C., 2015, ICLR
[4]   Deep Cross-Modal Audio-Visual Generation [J].
Chen, Lele ;
Srivastava, Sudhanshu ;
Duan, Zhiyao ;
Xu, Chenliang .
PROCEEDINGS OF THE THEMATIC WORKSHOPS OF ACM MULTIMEDIA 2017 (THEMATIC WORKSHOPS'17), 2017, :349-357
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]   Fuzzy model-based clustering and its application in image segmentation [J].
Choy, Siu Kai ;
Lam, Shu Yan ;
Yu, Kwok Wai ;
Lee, Wing Yan ;
Leung, King Tai .
PATTERN RECOGNITION, 2017, 68 :141-157
[7]  
Coates Adam, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P561, DOI 10.1007/978-3-642-35289-8_30
[8]   A retinal blood vessel segmentation based on improved D-MNet and pulse-coupled neural network [J].
Deng, Xiangyu ;
Ye, Jinhong .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 73
[9]   A Novel Data Placement Strategy for Data-Sharing Scientific Workflows in Heterogeneous Edge-Cloud Computing Environments [J].
Du, Xin ;
Tang, Songtao ;
Lu, Zhihui ;
Wu, Jie ;
Gai, Keke ;
Hung, Patrick C. K. .
2020 IEEE 13TH INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2020), 2020, :498-507
[10]   From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition [J].
Guo, Chen ;
Lin, Yaojin ;
Chen, Shengyu ;
Zeng, Zhichun ;
Shao, Mingwen ;
Li, Shaozi .
KNOWLEDGE-BASED SYSTEMS, 2022, 235