Low-Light Image Enhancement Based on RAW Domain Image

被引:0
|
作者
Chen L. [1 ]
Zhang Y. [1 ]
Lyu Z. [1 ]
Ding D. [1 ]
机构
[1] School of Information Science and Technology, Hangzhou Normal University, Hangzhou
关键词
Bayer pattern image; channel attention; convolutional neural network; image enhancement; low-light image;
D O I
10.3724/SP.J.1089.2023.19341
中图分类号
学科分类号
摘要
It is easier to model the noise in RAW image data (RAW images) than in RGB images because RAW images provide the original data without the nonlinear mapping of camera ISP. Therefore, this paper proposes a low-light image quality enhancement method in the RAW domain for clear and high-quality images. Firstly, the RAW image captured by the camera sensor is linearly interpolated to obtain a four-channel RGGB color image. Secondly, we generate more RAW images by applying different exposure levels on this RGGB image. Finally, we develop a neural network to learn the mapping between the RAW images with different exposure levels and reference images. Our proposed neural network adopts the autoencoder structure where the channel attention module is incorporated to extract and enhance the latent features of images. In the training, we design a new loss function that combines both structural similarity loss and gradient descent loss to guide the network to produce high quality images with high structural similarity and color relevance to the reference image. The proposed method is trained and tested on the See-In-the-Dark (SID) dataset. It achieves average 29.738 0 dB PSNR and 30.233 4 dB MPSNR, which outperforms state-of-the-art methods EnlightenGAN, Zero-DCE, SID, Residual, and ALEN. In terms of subjective quality, the images enhanced by the proposed method have no obvious noise and color spot artifacts, looking more visually pleasing and appealing than the images from previous methods. © 2023 Institute of Computing Technology. All rights reserved.
引用
收藏
页码:303 / 311
页数:8
相关论文
共 33 条
  • [1] Pizer S M, Amburn E P, Austin J D, Et al., Adaptive histogram equalization and its variations, Computer Vision, Graphics, and Image Processing, 39, 3, pp. 355-368, (1987)
  • [2] Pisano E D, Zong S Q, Hemminger B M, Et al., Contrast limited adaptive histogram equalization image processing to improve the detection of simulated spiculations in dense mammograms, Journal of Digital Imaging, 11, 4, (1998)
  • [3] Huang S C, Cheng F C, Chiu Y S., Efficient contrast enhancement using adaptive gamma correction with weighting distribution, IEEE Transactions on Image Processing, 22, 3, pp. 1032-1041, (2013)
  • [4] Land E H., The retinex, American Scientist, 52, 2, pp. 247-264, (1964)
  • [5] Jobson D J, Rahman Z, Woodell G A., Properties and performance of a center/surround retinex, IEEE Transactions on Image Processing, 6, 3, pp. 451-462, (1997)
  • [6] Jobson D J, Rahman Z, Woodell G A., A multiscale retinex for bridging the gap between color images and the human observation of scenes, IEEE Transactions on Image Processing, 6, 7, pp. 965-976, (1997)
  • [7] Dong X, Wang G, Pang Y, Et al., Fast efficient algorithm for enhancement of low lighting video, Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 1-6, (2011)
  • [8] Li L, Wang R G, Wang W M, Et al., A low-light image enhancement method for both denoising and contrast enlarging, Proceedings of the IEEE International Conference on Image Processing, pp. 3730-3734, (2015)
  • [9] Dabov K, Foi A, Katkovnik V, Et al., Image denoising by sparse 3-D transform-domain collaborative filtering, IEEE Transactions on Image Processing, 16, 8, pp. 2080-2095, (2007)
  • [10] Guo X J, Li Y, Ling H B., LIME: low-light image enhancement via illumination map estimation, IEEE Transactions on Image Processing, 26, 2, pp. 982-993, (2017)