LLDiffusion: Learning degradation representations in diffusion models for low-light image enhancement

被引:8
作者
Wang, Tao [1 ]
Zhang, Kaihao [2 ]
Zhang, Yong [3 ]
Luo, Wenhan [4 ]
Stenger, Bjorn [5 ]
Lu, Tong [1 ]
Kim, Tae-Kyun [6 ]
Liu, Wei [3 ]
机构
[1] Nanjing Univ, Natl Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] Harbin Inst Technol Shenzhen, Harbin, Peoples R China
[3] Tencent, Shenzhen, Peoples R China
[4] Hong Kong Univ Sci & Technol, Hong Kong, Peoples R China
[5] Rakuten Inst Technol, Tokyo, Japan
[6] Korea Adv Inst Sci & Technol, Daejeon, South Korea
关键词
Image enhancement; Diffusion model; Degradation representation; Degradation aware learning scheme;
D O I
10.1016/j.patcog.2025.111628
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current deep learning methods for low-light image enhancement typically rely on pixel-wise mappings using paired data, often overlooking the specific degradation factors inherent to low-light conditions, such as noise amplification, reduced contrast, and color distortion. This oversight can result in suboptimal performance. To address this limitation, we propose a degradation-aware learning framework that explicitly integrates degradation representations into the model design. We introduce LLDiffusion, a novel model composed of three key modules: a Degradation Generation Network (DGNET), a Dynamic Degradation-Aware Diffusion Module (DDDM), and a Latent Map Encoder (E). This approach enables joint learning of degradation representations, with the pre-trained Encoder (E) and DDDM effectively incorporating degradation and image priors into the diffusion process for improved enhancement. Extensive experiments on public benchmarks show that LLDiffusion outperforms state-of-the-art low-light image enhancement methods quantitatively and qualitatively. The source code and pre-trained models will be available at https://github.com/TaoWangzj/LLDiffusion.
引用
收藏
页数:13
相关论文
共 47 条
[1]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[2]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[3]   Seeing Motion in the Dark [J].
Chen, Chen ;
Chen, Qifeng ;
Do, Minh N. ;
Koltun, Vladlen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3184-3193
[4]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305
[5]   A fusion-based enhancing method for weakly illuminated images [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Liao, Yinghao ;
Ding, Xinghao ;
Paisley, John .
SIGNAL PROCESSING, 2016, 129 :82-96
[6]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[7]  
Guo L., 2022, arXiv
[8]   Toward Convolutional Blind Denoising of Real Photographs [J].
Guo, Shi ;
Yan, Zifei ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1712-1722
[9]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[10]  
Huang SD, 2024, Arxiv, DOI arXiv:2412.10817