Decoupled Low-Light Image Enhancement

被引:21
作者
Hao, Shijie [1 ,2 ]
Han, Xu [1 ,2 ]
Guo, Yanrong [1 ,2 ]
Wang, Meng [1 ,2 ]
机构
[1] Hefei Univ Technol, Key Lab Knowledge Engn Big Data, Minist Educ, 193 Tunxi Rd, Hefei, Peoples R China
[2] Hefei Univ Technol, Sch Comp Sci & Informat Engn, 193 Tunxi Rd, Hefei, Peoples R China
关键词
Image enhancement; low-light images; deep neural networks; decoupling degeneration; CONTRAST ENHANCEMENT; REPRESENTATION; FUSION;
D O I
10.1145/3498341
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The visual quality of photographs taken under imperfect lightness conditions can be degenerated by multiple factors, e.g., low lightness, imaging noise, color distortion, and so on. Current low-light image enhancement models focus on the improvement of low lightness only, or simply deal with all the degeneration factors as a whole, therefore leading to sub-optimal results. In this article, we propose to decouple the enhancement model into two sequential stages. The first stage focuses on improving the scene visibility based on a pixel-wise non-linear mapping. The second stage focuses on improving the appearance fidelity by suppressing the rest degeneration factors. The decoupled model facilitates the enhancement in two aspects. On the one hand, the whole low-light enhancement can be divided into two easier subtasks. The first one only aims to enhance the visibility. It also helps to bridge the large intensity gap between the low-light and normal-light images. In this way, the second subtask can be described as the local appearance adjustment. On the other hand, since the parameter matrix learned from the first stage is aware of the lightness distribution and the scene structure, it can be incorporated into the second stage as the complementary information. In the experiments, our model demonstrates the state-of-the-art performance in both qualitative and quantitative comparisons, compared with other low-light image enhancement models. In addition, the ablation studies also validate the effectiveness of our model in multiple aspects, such as model structure and loss function.
引用
收藏
页数:19
相关论文
共 45 条
[1]  
[Anonymous], 2011, Advances in Neural Information Processing Systems (NeurIPS)
[2]  
Ba J. L., 2016, Advances in Neural Information Processing Systems (NeurIPS), P1
[3]   A Joint Intrinsic-Extrinsic Prior Model for Retinex [J].
Cai, Bolun ;
Xu, Xiangmin ;
Guo, Kailing ;
Jia, Kui ;
Hu, Bin ;
Tao, Dacheng .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4020-4029
[4]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[5]  
Dong X, 2011, IEEE INT CON MULTI
[6]   A weighted variational model for simultaneous reflectance and illumination estimation [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Zhang, Xiao-Ping ;
Ding, Xinghao .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2782-2790
[7]   A fusion-based enhancing method for weakly illuminated images [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Liao, Yinghao ;
Ding, Xinghao ;
Paisley, John .
SIGNAL PROCESSING, 2016, 129 :82-96
[8]   Using Free Energy Principle For Blind Image Quality Assessment [J].
Gu, Ke ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (01) :50-63
[9]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[10]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993