DMPH-Net: a deep multi-scale pyramid hybrid network for low-light image enhancement with attention mechanism and noise reduction

被引:0
作者
Min He
Rugang Wang
Yuanyuan Wang
Feng Zhou
Naihong Guo
机构
[1] Yancheng Institute of Technology,School of Information Technology
[2] Yancheng XiongYing Precision Machinery Company Limited,undefined
来源
Signal, Image and Video Processing | 2023年 / 17卷
关键词
Low-light image enhancement; Retinex model; Pyramidal feature enhancement; Image denoising; Attention mechanism;
D O I
暂无
中图分类号
学科分类号
摘要
Aiming at the problems of color bias and noise enhancement on the output image by the traditional low-light image enhancement algorithm, we propose a deep multi-scale pyramid hybrid network (DMPH-Net) algorithm that fuses attention mechanism and multi-scale pyramid is proposed in this paper. The algorithm uses DecomNet to decompose reflectance and light components, and uses multi-scale illumination attention module to fuse light and reflectance for the decomposed low-light reflectance to improve the realism and details of reflectance; by using five-layer feature pyramid and kernel selection in PRID-net module to achieve the fusion of contextual information between different scale feature layers, while effectively removing the enhanced of noise, and the added color loss effectively suppresses the color bias of the output image; using multi-scale cascading and channel attention mechanisms to adjust the illumination and fuse the illumination ratios, effectively enhancing the brightness, texture, and other feature information in the image. The DMPH-Net algorithm is experimentally validated on LOL and no-reference LIME, MEF, and NPE datasets, and the objective evaluation metrics PSNR↑\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\uparrow $$\end{document}, SSIM↑\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\uparrow $$\end{document}, LIPIPS↓\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\downarrow $$\end{document}, and NIQE↓\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\downarrow $$\end{document} are 23.3772, 0.8442, 0.1386, and 3.5966 on LOL dataset. The objective evaluation metrics NIQE on the reference-free datasets LIME, NPE, and MEF are 3.0735, 3.1711, and 2.9464, respectively. The experiments show that the DMPH-Net algorithm maintains high image details and textures in image enhancement and denoising, effectively enhances low-light images, and reduces noise and color bias of images. Compared with RUAS, UnRetinex-Net, and other enhancement algorithms, it improves in objective evaluation metrics PSNR, SSIM, LIPIPS, and NIQE.
引用
收藏
页码:4533 / 4542
页数:9
相关论文
共 20 条
  • [1] Li ZL(2023)A method for enhancing low light images in coal mines based on noisy retinex model J. Mine Autom. 26 982-993
  • [2] Cao W(2023)Deep neural network-based image enhancement algorithm for low-illumination images underground mines Coal Sci. Technol. 104 15-22
  • [3] Hw Wang(2017)Lime: low-light image enhancement via illumination map estimation IEEE Trans. Image Process. 129 1013-1037
  • [4] Wang ML(2018)Lightennet: a convolutional neural network for weakly illuminated image enhancement Pattern Recognit. Lett. 29 8339-8354
  • [5] Zhang H(2021)Beyond brightening low-light images Int. J. Comput. Vis. 30 2340-2349
  • [6] Guo X(2020)Collaborative filtering of correlated noise: exact transform-domain variance for improved shrinkage and patch matching IEEE Trans. Image Process. undefined undefined-undefined
  • [7] Ling H(2021)Enlightengan: deep light enhancement without paired supervision IEEE Trans. Image Process. undefined undefined-undefined
  • [8] Li Y(undefined)undefined undefined undefined undefined-undefined
  • [9] Li C(undefined)undefined undefined undefined undefined-undefined
  • [10] Porikli F(undefined)undefined undefined undefined undefined-undefined