End-to-end single image enhancement based on a dual network cascade model

被引:15
作者
Chen, Yeyao [1 ]
Yu, Mei [1 ,2 ]
Jiang, Gangyi [1 ,2 ]
Peng, Zongju [1 ]
Chen, Fen [1 ]
机构
[1] Ningbo Univ, Fac Informat Sci & Engn, Ningbo, Zhejiang, Peoples R China
[2] Nanjing Univ, Natl Key Lab Software New Technol, Nanjing, Jiangsu, Peoples R China
关键词
Single image enhancement; Convolutional neural network; Dual network cascade model; Exposure prediction; Exposure fusion; HIGH DYNAMIC-RANGE; QUALITY ASSESSMENT; FUSION;
D O I
10.1016/j.jvcir.2019.04.008
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A single-exposure image may lose details because of the imaging dynamic range limitations of single camera sensor. Multi-image fusion techniques are often used to improve the image quality, but if there are moving objects in the scene, the fused images may result in ghost artifacts. In order to avoid this problem and enhance single-exposure images, this paper proposes a dual network cascade model for single image enhancement, including exposure prediction network and exposure fusion network. First, the exposure prediction network generates two under-/over-exposure images that differ from the input normal-exposure image so as to recover the lost details of the under-exposed/over-exposed regions. Then, the exposure fusion network fuses the input image and the generated under-/over-exposure images to generate the final enhanced image. The loss function constructed by a structural dissimilarity index is used to alleviate chessboard artifacts in the generated image. Further, through three-phase training, the model robustly generates enhanced images without any post-processing. The experimental results demonstrate that the proposed method can effectively improve the image contrast and reconstruct details of under-exposed/over-exposed regions in the original image. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:284 / 295
页数:12
相关论文
共 42 条
[1]   Do HDR displays support LDR content?: a psychophysical evaluation [J].
Akyuez, Ahmet Oguz ;
Fleming, Roland ;
Riecke, Bernhard E. ;
Reinhard, Erik ;
Buethoff, Heinrich H. .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[2]  
[Anonymous], 2016, P 4 INT C LEARN REPR
[3]  
[Anonymous], 2012, NEURIPS 2012
[4]   High Dynamic Range Imaging Technology [J].
Artusi, Alessandro ;
Richter, Thomas ;
Ebrahimi, Touradj ;
Mantiuk, Rafal K. .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (05) :165-172
[5]  
Banterle Francesco, 2006, P 4 INT C COMP GRAPH, P349
[6]  
Bashfordrogers T., 2018, COMPUTER GRAPHICS FO, V37
[7]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[8]   Contextual and Variational Contrast Enhancement [J].
Celik, Turgay ;
Tjahjadi, Tardi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (12) :3431-3441
[9]  
Debevec P. E., 1997, Computer Graphics Proceedings, SIGGRAPH 97, P369, DOI 10.1145/258734.258884
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307