Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [31] White balancing, quad-tree decomposition, and L1 minimization-based single-image dehazing
    Iqbal, Mehwish
    Riaz, M. Mohsin
    Ghafoor, Abdul
    Ahmed, Attiq
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (04)
  • [32] An efficient dehazing method of single image using multi-scale fusion technique
    Bhavani M.D.L.
    Murugan R.
    Goel T.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9059 - 9071
  • [33] Multi-Scale Attention Feature Enhancement Network for Single Image Dehazing
    Dong, Weida
    Wang, Chunyan
    Sun, Hao
    Teng, Yunjie
    Xu, Xiping
    SENSORS, 2023, 23 (19)
  • [34] Multi-Scale Density-Aware Network for Single Image Dehazing
    Gao, Tao
    Liu, Yao
    Cheng, Peng
    Chen, Ting
    Liu, Lidong
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1117 - 1121
  • [35] HRN: HAZE-RELEVANT NETWORK USING MULTI-OBJECT CONSTRAINTS FOR SINGLE IMAGE DEHAZING
    Huang, Shuying
    Ren, Mingyang
    Wu, Donglei
    Yang, Yong
    Wan, Weiguo
    Wei, Yingzhi
    COMPUTING AND INFORMATICS, 2024, 43 (02) : 266 - 294
  • [36] Multi-stream fish detection in unconstrained underwater videos by the fusion of two convolutional neural network detectors
    Abdelouahid Ben Tamou
    Abdesslam Benzinou
    Kamal Nasreddine
    Applied Intelligence, 2021, 51 : 5809 - 5821
  • [37] Multi-stream fish detection in unconstrained underwater videos by the fusion of two convolutional neural network detectors
    Ben Tamou, Abdelouahid
    Benzinou, Abdesslam
    Nasreddine, Kamal
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5809 - 5821
  • [38] Generative Adversarial Network Based on Multi-scale Dense Feature Fusion for Image Dehazing
    Lian J.
    Chen S.
    Ding K.
    Li L.-H.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2022, 43 (11): : 1591 - 1598
  • [39] Single Image Dehazing Method Based on Multi-Scale Convolution Neural Network
    Chen Yong
    Guo Hongguang
    Ai Yapeng
    ACTA OPTICA SINICA, 2019, 39 (10)
  • [40] Tsnet: a two-stage network for image dehazing with multi-scale fusion and adaptive learning
    Gong, Xiaolin
    Zheng, Zehan
    Du, Heyuan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (10) : 7119 - 7130