Joint rain and atmospheric veil removal from single image

被引:3
作者
Mi, Zetian [1 ]
Wang, Yafei [1 ]
Zhao, Congcong [1 ]
Du, Fengming [2 ]
Fu, Xianping [1 ]
机构
[1] Dalian Maritime Univ, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Dalian Maritime Univ, Coll Marine Engn, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
image colour analysis; visibility; rain; Gaussian processes; image enhancement; image restoration; learning (artificial intelligence); joint rain; atmospheric veil removal; single image; natural rainy scenes; nearby individual rain streaks; atmospheric veiling effect; distant accumulated rain; rain accumulation; generalised rain model; atmospheric light; natural heavy rain scenario; MODEL;
D O I
10.1049/iet-ipr.2019.0952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In natural rainy scenes, visibility is significantly degraded by two types of phenomena: specular highlights of nearby individual rain streaks and atmospheric veiling effect caused by distant accumulated rain. However, most existing deraining methods only take the first kind of degradation into consideration, which limits their potential application in heavy rain. In this study, a joint rain and atmospheric veil removal framework is proposed to address this problem. Since rain streaks and rain accumulation are entangled with each other, which is intractable to simulate, causing clean/rainy image pairs of real-world are hard to generate. Hence, after introducing a generalised rain model, which can represent both rain streaks and atmospheric veil physically, the authors do not learn the mapping function between image pairs using deep-learning architecture, but estimate the rain streaks, transmission, and atmospheric light via Gaussian mixture model patch prior and dark channel prior to solve the rain model instead. According to the comprehensive experimental evaluations, the proposed method outperforms other state-of-the-art methods in terms of both high visibility and vivid colour, especially in natural heavy rain scenario.
引用
收藏
页码:1150 / 1156
页数:7
相关论文
共 29 条
  • [1] [Anonymous], IEEE INT C COMP VIS
  • [2] [Anonymous], EUR C COMP VIS MUN G
  • [3] [Anonymous], P SPIE
  • [4] Analysis of Rain and Snow in Frequency Space
    Barnum, Peter C.
    Narasimhan, Srinivasa
    Kanade, Takeo
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 86 (2-3) : 256 - 274
  • [5] DehazeNet: An End-to-End System for Single Image Haze Removal
    Cai, Bolun
    Xu, Xiangmin
    Jia, Kui
    Qing, Chunmei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) : 5187 - 5198
  • [6] A Generalized Low-Rank Appearance Model for Spatio-Temporally Correlated Rain Streaks
    Chen, Yi-Lei
    Hsu, Chiou-Ting
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1968 - 1975
  • [7] A directional global sparse model for single image rain removal
    Deng, Liang-Jian
    Huang, Ting-Zhu
    Zhao, Xi-Le
    Jiang, Tai-Xiang
    [J]. APPLIED MATHEMATICAL MODELLING, 2018, 59 : 662 - 679
  • [8] Restoring An Image Taken Through a Window Covered with Dirt or Rain
    Eigen, David
    Krishnan, Dilip
    Fergus, Rob
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 633 - 640
  • [9] Removing rain from single images via a deep detail network
    Fu, Xueyang
    Huang, Jiabin
    Zeng, Delu
    Huang, Yue
    Ding, Xinghao
    Paisley, John
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1715 - 1723
  • [10] Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal
    Fu, Xueyang
    Huang, Jiabin
    Ding, Xinghao
    Liao, Yinghao
    Paisley, John
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (06) : 2944 - 2956