Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [21] FFA-Net: Feature Fusion Attention Network for Single Image Dehazing
    Qin, Xu
    Wang, Zhilin
    Bai, Yuanchao
    Xie, Xiaodong
    Jia, Huizhu
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11908 - 11915
  • [22] Single Image Dehazing via Saliency Weighted Multi-exposure Fusion
    Li Hongyun
    Shi Yun
    Gao Yin
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (01) : 261 - 270
  • [23] AFT-Net: Active Fusion-Transduction for Multi-stream Medical Image Segmentation
    Shu, Yucheng
    Zhang, Jing
    Xiao, Bin
    Luan, Xiao
    Liu, Linghui
    Hu, Chunlong
    2020 IEEE 32ND INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI), 2020, : 753 - 760
  • [24] Single Image Dehazing via Fusion of Multilevel Attention Network for Vision-Based Measurement Applications
    Sahu, Geet
    Seal, Ayan
    Jaworek-Korjakowska, Joanna
    Krejcar, Ondrej
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [25] A multi-scale fusion scheme based on haze-relevant features for single image dehazing
    Li, Yunan
    Miao, Qiguang
    Liu, Ruyi
    Song, Jianfeng
    Quan, Yining
    Huang, Yuhui
    NEUROCOMPUTING, 2018, 283 : 73 - 86
  • [26] Deep multi-scale network for single image dehazing with self-guided maps
    Liu, Jianlei
    Yu, Hao
    Zhang, Zhongzheng
    Chen, Chen
    Hou, Qianwen
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (06) : 2867 - 2875
  • [27] Adaptive feature fusion network based on boosted attention mechanism for single image dehazing
    Zhao Wang
    Feng Li
    Runmin Cong
    Huihui Bai
    Yao Zhao
    Multimedia Tools and Applications, 2022, 81 : 11325 - 11339
  • [28] Multi-Scale Density-Aware Network for Single Image Dehazing
    Gao, Tao
    Liu, Yao
    Cheng, Peng
    Chen, Ting
    Liu, Lidong
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1117 - 1121
  • [29] Multiscale feature fusion deep network for single image dehazing with continuous memory mechanism
    Xie Z.
    Li Q.
    Zong S.
    Liu G.
    Optik, 2023, 287
  • [30] Multi-scale feature aggregation network for single-image dehazing
    Zhao, Donghui
    Mo, Bo
    Zhu, Xiang
    IET IMAGE PROCESSING, 2024, 18 (11) : 2943 - 2961