A Wave-Shaped Deep Neural Network for Smoke Density Estimation

被引:88
作者
Yuan, Feiniu [1 ]
Zhang, Lin [2 ,3 ]
Xia, Xue [2 ]
Huang, Qinghua [4 ,5 ]
Li, Xuelong [5 ,6 ]
机构
[1] Shanghai Normal Univ, Coll Informat Mech & Elect Engn, Shanghai 201418, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Jiangxi Sci & Technol Normal Univ, Sch Math & Comp Sci, Nanchang 330038, Jiangxi, Peoples R China
[4] Northwestern Polytech Univ, Sch Mech Engn, Xian 710072, Peoples R China
[5] Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710072, Peoples R China
[6] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Image segmentation; Feature extraction; Semantics; Image color analysis; Decoding; Visualization; Deep neural network; W-Net; smoke density estimation; smoke segmentation; smoke simulation; VIDEO; IMAGE; SEPARATION;
D O I
10.1109/TIP.2019.2946126
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smoke density estimation from a single image is a totally new but highly ill-posed problem. To solve the problem, we stack several convolutional encoder-decoder structures together to propose a wave-shaped neural network, termed W-Net. Stacking encoder-decoders directly increases the network depth, leading to the enlargement of receptive fields for encoding more semantic information. To maximize the degrees of feature re-usage, we copy and resize the outputs of encoding layers to corresponding decoding layers, and then concatenate them to implement short-cut connections for improving spatial accuracy. The crests and troughs of W-Net are special structures containing abundant localization and semantic information, so we also use short-cut connections between these structures and decoding layers. Estimated smoke density is useful in many applications, such as smoke segmentation, smoke detection, disaster simulation. Experimental results show that our method outperforms existing methods on both smoke density estimation and segmentation. It also achieves satisfying results in visual detection of auto exhausts.
引用
收藏
页码:2301 / 2313
页数:13
相关论文
共 50 条
[11]   Dense estimation of fluid flows [J].
Corpetti, T ;
Mémin, É ;
Pérez, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :365-380
[12]   Higher Order Linear Dynamical Systems for Smoke Detection in Video Surveillance Applications [J].
Dimitropoulos, Kosmas ;
Barmpoutis, Panagiotis ;
Grammalidis, Nikos .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (05) :1143-1154
[13]   FlowNet: Learning Optical Flow with Convolutional Networks [J].
Dosovitskiy, Alexey ;
Fischer, Philipp ;
Ilg, Eddy ;
Haeusser, Philip ;
Hazirbas, Caner ;
Golkov, Vladimir ;
van der Smagt, Patrick ;
Cremers, Daniel ;
Brox, Thomas .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2758-2766
[14]   Fast Smoke Detection for Video Surveillance Using CUDA [J].
Filonenko, Alexander ;
Caceres Hernandez, Danilo ;
Jo, Kang-Hyun .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (02) :725-733
[15]  
Foster N., 1997, Computer Graphics Proceedings, SIGGRAPH 97, P181, DOI 10.1145/258734.258838
[16]   Realistic animation of liquids [J].
Foster, N ;
Metaxas, D .
GRAPHICAL MODELS AND IMAGE PROCESSING, 1996, 58 (05) :471-483
[17]  
Geiman J.A., 2003, Fire Safety Science-Proceedings of the Seventh International Symposium, P197, DOI DOI 10.3801/IAFSS.FSS.7-197
[18]  
He KM, 2014, LECT NOTES COMPUT SC, V8691, P346, DOI [arXiv:1406.4729, 10.1007/978-3-319-10578-9_23]
[19]  
He KM, 2009, PROC CVPR IEEE, P1956, DOI [10.1109/CVPRW.2009.5206515, 10.1109/CVPR.2009.5206515]
[20]   Appearance Modeling via Proxy-to-Image Alignment [J].
Huang, Hui ;
Xie, Ke ;
Ma, Lin ;
Lischinski, Dani ;
Gong, Minglun ;
Tong, Xin ;
Cohen-Or, Daniel .
ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (01)