Single Image Brightening via Multi-Scale Exposure Fusion With Hybrid Learning

被引:38
作者
Zheng, Chaobing [1 ]
Li, Zhengguo [2 ]
Yang, Yi [1 ]
Wu, Shiqian [1 ]
机构
[1] Wuhan Univ Sci & Technol, Inst Robot & Intelligent Syst, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
[2] Inst Infocomm Res, Singapore 138632, Singapore
基金
中国国家自然科学基金;
关键词
Distortion; Image color analysis; Lighting; Machine learning; Cameras; Colored noise; ISO; Single image brightening; hybrid learning; virtual image; multi-scale exposure fusion; data-driven; model-driven; NEURAL-NETWORK; ENHANCEMENT; ILLUMINATION;
D O I
10.1109/TCSVT.2020.3009235
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A small ISO and a small exposure time are usually used to capture an image in back- or low-light condition which results in an image with negligible motion blur and small noise but looks dark. In this paper, a single image brightening algorithm is introduced to brighten such an image. The proposed algorithm includes a unique hybrid learning framework to generate two virtual images with large exposure times. The virtual images are first generated via intensity mapping functions (IMFs) which are computed using camera response functions (CRFs) and this is a model-driven approach. Both the virtual images are then enhanced by using a data-driven approach, i.e. a residual convolutional neural network to approach the ground truth images. The model-driven approach and the data-driven one compensate each other in the proposed hybrid learning framework. The final brightened image is obtained by fusing the original image and two virtual images via a multi-scale exposure fusion algorithm with properly defined weights. Experimental results show that the proposed brightening algorithm outperforms existing algorithms in terms of MEF-SSIM metric.
引用
收藏
页码:1425 / 1435
页数:11
相关论文
共 41 条
  • [1] [Anonymous], 2008, IEEE CONTR SYST MAG
  • [2] [Anonymous], 2008, ACM SIGGRAPH 2008 classes, page, DOI DOI 10.1145/1401132.1401174
  • [3] DehazeNet: An End-to-End System for Single Image Haze Removal
    Cai, Bolun
    Xu, Xiangmin
    Jia, Kui
    Qing, Chunmei
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) : 5187 - 5198
  • [4] Fuzzy Fusion Based High Dynamic Range Imaging using Adaptive Histogram Separation
    Celebi, Aysun Tasyapi
    Duvar, Ramazan
    Urhan, Oguzhan
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2015, 61 (01) : 119 - 127
  • [5] Contextual and Variational Contrast Enhancement
    Celik, Turgay
    Tjahjadi, Tardi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (12) : 3431 - 3441
  • [6] Learning to See in the Dark
    Chen, Chen
    Chen, Qifeng
    Xu, Jia
    Koltun, Vladlen
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3291 - 3300
  • [7] A weighted variational model for simultaneous reflectance and illumination estimation
    Fu, Xueyang
    Zeng, Delu
    Huang, Yue
    Zhang, Xiao-Ping
    Ding, Xinghao
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2782 - 2790
  • [8] A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation
    Fu, Xueyang
    Liao, Yinghao
    Zeng, Delu
    Huang, Yue
    Zhang, Xiao-Ping
    Ding, Xinghao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 4965 - 4977
  • [9] Wavelet Deep Neural Network for Stripe Noise Removal
    Guan, Juntao
    Lai, Rui
    Xiong, Ai
    [J]. IEEE ACCESS, 2019, 7 : 44544 - 44554
  • [10] LIME: Low-Light Image Enhancement via Illumination Map Estimation
    Guo, Xiaojie
    Li, Yu
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) : 982 - 993