MCLL-Diff: Multiconditional Low-Light Image Enhancement Based on Diffusion Probabilistic Models

被引:0
|
作者
Chen, Fengxin [1 ,2 ]
Yu, Ye [1 ,2 ]
Yi, Jun [3 ]
Zhang, Ting [1 ,2 ]
Zhao, Ji [4 ]
Jia, Wei [1 ,2 ]
Yu, Jun [5 ]
机构
[1] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230601, Peoples R China
[2] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230601, Peoples R China
[3] Huanggang Normal Univ, Sch Comp, Huanggang 438000, Hubei, Peoples R China
[4] Univ Sci & Technol China, Inst Adv Technol, Hefei 230093, Peoples R China
[5] Univ Sci & Technol China, Sch Informat Sci & Technol, Dept Automat, Hefei 230093, Peoples R China
基金
中国国家自然科学基金;
关键词
Noise; Lighting; Training; Learning systems; Visualization; Image enhancement; Gray-scale; Electronic mail; Diffusion models; Predictive models; Diffusion probabilistic model (DPM); generative model; low-light image enhancement (LLIE); nighttime vehicle recognition;
D O I
10.1109/JSEN.2025.3534566
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the inherent limitations of camera sensors in capturing adequate light under low-light conditions, images often suffer from various degradation issues, such as illumination imbalances, artifacts, and noise. While generative model-based methods have made remarkable progress in low-light image enhancement (LLIE), they still face challenges such as unstable training and inconsistent generation quality. To address these challenges, we introduce MCLL-Diff, a novel multiconditional LLIE method based on diffusion probabilistic model (DPM). MCLL-Diff retains the forward process of DPM but introduces a unique multiconditional noise predictor (MCNP) in the reverse process. We first propose a learnable operator module (LOM) to enrich the prior knowledge incorporated in the reverse process. Then, we use MCNP to effectively integrate prior knowledge, low-light images, intermediate variables, and time steps to accurately predict noise. To validate the effectiveness of MCLL-Diff in high-level computer vision tasks, we construct a large-scale nighttime vehicle model (NVM) dataset from real-world nighttime street scenarios. Extensive experiments on benchmark datasets demonstrate MCLL-Diff's superiority in both generalization performance and visual quality. Specifically, we achieved a significant improvement of 0.1 dB in peak signal-to-noise ratio (PSNR) metric on the VE-LOL dataset, and a notable increase of 0.76% in Top-1 accuracy when applied to object recognition on the NVM dataset.
引用
收藏
页码:9912 / 9924
页数:13
相关论文
共 50 条
  • [1] Low-Light Image Enhancement with Wavelet-based Diffusion Models
    Jiang, Hai
    Luo, Ao
    Fan, Haoqiang
    Han, Songchen
    Liu, Shuaicheng
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (06):
  • [2] Pyramid Diffusion Models for Low-light Image Enhancement
    Zhou, Dewei
    Yang, Zongxin
    Yang, Yi
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1795 - 1803
  • [3] LL-Diff: Low-Light Image Enhancement Utilizing Langevin Sampling Diffusion
    Ding, Boren
    Zhang, Xiaofeng
    Yu, Zekun
    Hui, Zheng
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024,
  • [4] Diff-Retinex: Rethinking Low-light Image Enhancement with A Generative Diffusion Model
    Yi, Xunpeng
    Xu, Han
    Zhang, Hao
    Tang, Linfeng
    Ma, Jiayi
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12268 - 12277
  • [5] Low-Light Image Enhancement Based on Maximal Diffusion Values
    Kim, Wonjun
    Lee, Ryong
    Park, Minwoo
    Lee, Sang-Hwan
    IEEE ACCESS, 2019, 7 : 129150 - 129163
  • [6] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [7] LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models
    Jiang, Hai
    Luo, Ao
    Liu, Xiaohong
    Han, Songchen
    Liu, Shuaicheng
    COMPUTER VISION - ECCV 2024, PT XLVIII, 2025, 15106 : 161 - 179
  • [8] INTEGRATION-AND-DIFFUSION NETWORK FOR LOW-LIGHT IMAGE ENHANCEMENT
    Tang, Pengliang
    Guo, Xiaoqiang
    Ju, Guodong
    Shen, Liangheng
    Men, Aidong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1664 - 1668
  • [9] Effective method for low-light image enhancement based on the JND and OCTM models
    Lang, Yi-Zheng
    Wang, Yi-Lun
    Qian, Yun-Sheng
    Kong, Xiang-Yu
    Cao, Yang
    OPTICS EXPRESS, 2023, 31 (09) : 14008 - 14026
  • [10] Low-light image enhancement based on variational image decomposition
    Su, Yonggang
    Yang, Xuejie
    MULTIMEDIA SYSTEMS, 2024, 30 (06)