A Wave-Shaped Deep Neural Network for Smoke Density Estimation

被引:88
作者
Yuan, Feiniu [1 ]
Zhang, Lin [2 ,3 ]
Xia, Xue [2 ]
Huang, Qinghua [4 ,5 ]
Li, Xuelong [5 ,6 ]
机构
[1] Shanghai Normal Univ, Coll Informat Mech & Elect Engn, Shanghai 201418, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Jiangxi Sci & Technol Normal Univ, Sch Math & Comp Sci, Nanchang 330038, Jiangxi, Peoples R China
[4] Northwestern Polytech Univ, Sch Mech Engn, Xian 710072, Peoples R China
[5] Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710072, Peoples R China
[6] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Image segmentation; Feature extraction; Semantics; Image color analysis; Decoding; Visualization; Deep neural network; W-Net; smoke density estimation; smoke segmentation; smoke simulation; VIDEO; IMAGE; SEPARATION;
D O I
10.1109/TIP.2019.2946126
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smoke density estimation from a single image is a totally new but highly ill-posed problem. To solve the problem, we stack several convolutional encoder-decoder structures together to propose a wave-shaped neural network, termed W-Net. Stacking encoder-decoders directly increases the network depth, leading to the enlargement of receptive fields for encoding more semantic information. To maximize the degrees of feature re-usage, we copy and resize the outputs of encoding layers to corresponding decoding layers, and then concatenate them to implement short-cut connections for improving spatial accuracy. The crests and troughs of W-Net are special structures containing abundant localization and semantic information, so we also use short-cut connections between these structures and decoding layers. Estimated smoke density is useful in many applications, such as smoke segmentation, smoke detection, disaster simulation. Experimental results show that our method outperforms existing methods on both smoke density estimation and segmentation. It also achieves satisfying results in visual detection of auto exhausts.
引用
收藏
页码:2301 / 2313
页数:13
相关论文
共 50 条
[1]  
[Anonymous], 2013, BAIU PEOPLE SEGMENTA
[2]  
[Anonymous], 2012, Pascal Visual Object Classes
[3]   A video-based smoke detection using smoke flow pattern and spatial-temporal energy analyses for alarm systems [J].
Appana, Dileep K. ;
Islam, Rashedul ;
Khan, Sheraz A. ;
Kim, Jong-Myon .
INFORMATION SCIENCES, 2017, 418 :91-101
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[6]   Vision based smoke detection system using image energy and color information [J].
Calderara, Simone ;
Piccinini, Paolo ;
Cucchiara, Rita .
MACHINE VISION AND APPLICATIONS, 2011, 22 (04) :705-719
[7]   Dense Motion Estimation for Smoke [J].
Chen, Da ;
Li, Wenbin ;
Hall, Peter .
COMPUTER VISION - ACCV 2016, PT IV, 2017, 10114 :225-239
[8]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[9]  
Chen L, 2015, RSC SMART MATER, P1
[10]  
Chuang YY, 2001, PROC CVPR IEEE, P264