Content Feature and Style Feature Fusion Network for Single Image Dehazing

被引:0
作者
Yang A.-P. [1 ]
Liu J. [1 ]
Xing J.-N. [1 ]
Li X.-X. [1 ]
He Y.-Q. [1 ]
机构
[1] School of Electrical and Information Engineering, Tianjin University, Tianjin
来源
Zidonghua Xuebao/Acta Automatica Sinica | 2023年 / 49卷 / 04期
基金
中国国家自然科学基金;
关键词
channel-wise attention; color-maintaining; convolutional neural network (CNN); feature fusion; Image dehazing;
D O I
10.16383/j.aas.c200217
中图分类号
学科分类号
摘要
Although recent research has shown the potential of using deep learning to accomplish single image dehazing, existing methods still have some problems, such as poor visibility and color distortion. To overcome these shortcomings, we present a content feature and style feature fusion network for single image dehazing. The dehazing network consists of three parts: Feature extraction sub-network, feature fusion sub-network and image restoration sub-network. The feature extraction sub-network consists of a content feature extraction module and a style feature extraction module, which can learn image content and image style respectively to achieve pleasing dehazing results and maintain original color characteristics simultaneously. In the feature fusion sub-network, the channel-wise attention mechanism is adopted to weight the feature maps generated from the content feature extraction module in order to learn the most important features of the image, and then the weighted content feature map and style feature map are fused by convolution operation. Finally, a non-linear mapping is performed to recover the dehazed image. Compared with the existing approaches, the proposed network can obtain superior results on synthetic and real images, and can avoid the color distortion effectively. © 2023 Science Press. All rights reserved.
引用
收藏
页码:769 / 777
页数:8
相关论文
共 25 条
[1]  
Wu Di, Zhu Qing-Song, The latest research progress of image dehazing, Acta Automatica Sinica, 41, 2, pp. 221-239, (2015)
[2]  
Xu H T, Zhai G T, Wu X L, Yang X K., Generalized equalization model for image enhancement, IEEE Transactions on Multimedia, 16, 1, (2014)
[3]  
Jiang B, Woodell G A, Jobson D J., Novel multi-scale retinex with color restoration on graphics processing unit, Journal of Real-time Image Processing, 10, 2, (2015)
[4]  
Narasimhan S G, Nayar S K., Vision and the atmosphere, International Journal of Computer Vision, 48, 3, (2002)
[5]  
He K M, Sun J, Tang X O., Single image haze removal using dark channel prior, IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 12, pp. 2341-2353, (2010)
[6]  
Berman D, Treibitz T, Avidan S., Non-local image dehazing, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1674-1682, (2016)
[7]  
Zhu Q S, Mai J M, Shao L., A fast single image haze removal algorithm using color attenuation prior, IEEE Transactions on Image Processing, 24, 11, pp. 3522-3533, (2015)
[8]  
Yang Yan, Chen Gao-Ke, Zhou Jie, Iterative optimization defogging algorithm using Gaussian weight decay, Acta Automatica Sinica, 45, 4, pp. 819-828, (2019)
[9]  
Cai B L, Xu X M, Jia K, Qing C M, Tao D C., DehazeNet: An end-to-end system for single image haze removal, IEEE Transactions on Image Processing, 25, 11, pp. 5187-5198, (2016)
[10]  
Ren W Q, Liu S, Zhang H, Pan J S, Cao X C, Yang M H., Single image dehazing via multi-scale convolutional neural networks, Proceedings of the European Conference on Computer Vision, pp. 154-169, (2016)