Multi-Stream Fusion Network With Generalized Smooth L1 Loss for Single Image Dehazing

被引:21
|
作者
Zhu, Xinshan [1 ,2 ]
Li, Shuoshi [1 ]
Gan, Yongdong [1 ]
Zhang, Yun [1 ]
Sun, Biao [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] State Key Lab Digital Publishing Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Image dehazing; convolutional neural networks; feature fusion; loss function; supervision learning; VISIBILITY; FRAMEWORK; WEATHER; VISION;
D O I
10.1109/TIP.2021.3108022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image dehazing is an important but challenging computer vision problem. For the problem, an end-toend convolutional neural network, named multi-stream fusion network (MSFNet), is proposed in this paper. MSFNet is built following the encoder-decoder network structure. The encoder is a three-stream network to produce features at three resolution levels. Residual dense blocks (RDBs) are used for feature extraction. The resizing blocks serve as bridges to connect different streams. The features from different streams are fused in a full connection manner by a feature fusion block, with stream- wise and channel-wise attention mechanisms. The decoder directly regresses the dehazed image from coarse to fine by the use of RDBs and the skip connections. To train the network, we design a generalized smooth L-1 loss function, which is a parametric loss family and permits to adjust the insensitivity to the outliers by varying the parameter settings. Moreover, to guide MSFNet to capture the valid features in each stream, we propose the multi-scale supervision learning strategy, where the loss at each resolution level is computed and summed as the final loss. Extensive experimental results demonstrate that the proposed MSFNet achieves superior performance on both synthetic and real-world images, as compared with the state-of-the-art single image dehazing methods.
引用
收藏
页码:7620 / 7635
页数:16
相关论文
共 50 条
  • [41] Deep multi-scale network for single image dehazing with self-guided maps
    Jianlei Liu
    Hao Yu
    Zhongzheng Zhang
    Chen Chen
    Qianwen Hou
    Signal, Image and Video Processing, 2023, 17 : 2867 - 2875
  • [42] Single Sea Surface Image Dehazing Using Multi-scale Cascaded Convolutional Neural Network
    Ju, Qingqing
    Li, Chaofeng
    Sang, Qingqing
    2018 INTERNATIONAL SYMPOSIUM IN SENSING AND INSTRUMENTATION IN IOT ERA (ISSI), 2018,
  • [43] CONTRAST ENHANCEMENT BASED SINGLE IMAGE DEHAZING VIA TV-l1 MINIMIZATION
    Li, Liang
    Feng, Wei
    Zhang, Jiawan
    2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2014,
  • [44] One-Sided Unsupervised Image Dehazing Network Based on Feature Fusion and Multi-Scale Skip Connection
    Yang, Yuanbo
    Lv, Qunbo
    Zhu, Baoyu
    Sui, Xuefu
    Zhang, Yu
    Tan, Zheng
    APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [45] A Multi-scale Single Ultra-High-Definition Image Dehazing Method Based on Multi-resolution Feature Fusion
    Xue, Ping
    Zhang, Yixin
    Bai, Yurao
    Deng, Shixiong
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, : 3410 - 3431
  • [46] MLCTA-Net: multi-scale large convolution and triplet attention network for single image dehazing
    Tang, Qingshan
    Miao, Yongqi
    Huang, Xinwei
    Jiang, Huang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [47] Oriented Object Detection in Aerial Images Based on the Scaled Smooth L1 Loss Function
    Wei, Linhai
    Zheng, Chen
    Hu, Yijun
    REMOTE SENSING, 2023, 15 (05)
  • [49] A two-stage fusion remote sensing image dehazing network based on multi-scale feature and hybrid attention
    Miao, Mengjun
    Huang, Heming
    Da, Feipeng
    Song, Dongke
    Fan, Yonghong
    Zhang, Miao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 373 - 383
  • [50] GridDehazeNet plus : An Enhanced Multi-Scale Network With Intra-Task Knowledge Transfer for Single Image Dehazing
    Liu, Xiaohong
    Shi, Zhihao
    Wu, Zijun
    Chen, Jun
    Zhai, Guangtao
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) : 870 - 884