CLE Diffusion: Controllable Light Enhancement Diffusion Model

被引:16
作者
Yin, Yuyang [1 ]
Xu, Dejia [2 ]
Tan, Chuangchuang [1 ]
Liu, Ping [3 ]
Zhao, Yao [1 ]
Wei, Yunchao [1 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing Key Lab Adv Informat Sci & Network, Beijing, Peoples R China
[2] Univ Texas Austin, VITA Grp, Austin, TX USA
[3] ASTAR, IHPC, Ctr Frontier AI Res, Singapore, Singapore
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
关键词
image processing; low light image enhancement; diffusion model; ILLUMINATION; RETINEX;
D O I
10.1145/3581783.3612145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low light enhancement has gained increasing importance with the rapid development of visual creation and editing. However, most existing enhancement algorithms are designed to homogeneously increase the brightness of images to a pre-defined extent, limiting the user experience. To address this issue, we propose Controllable Light Enhancement Diffusion Model, dubbed CLE Diffusion, a novel diffusion framework to provide users with rich controllability. Built with a conditional diffusion model, we introduce an illumination embedding to let users control their desired brightness level. Additionally, we incorporate the Segment-Anything Model (SAM) to enable user-friendly region controllability, where users can click on objects to specify the regions they wish to enhance. Extensive experiments demonstrate that CLE Diffusion achieves competitive performance regarding quantitative metrics, qualitative results, and versatile controllability. Project page: https://yuyangyin.github.io/CLEDiffusion/
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [21] BDMUIE: Underwater image enhancement based on Bayesian diffusion model
    Chen, Lingfeng
    Xu, Zhihan
    Wei, Chao
    Xu, Yuanxin
    NEUROCOMPUTING, 2025, 620
  • [22] Efficient and Controllable Remote Sensing Fake Sample Generation Based on Diffusion Model
    Yuan, Zhiqiang
    Hao, Chongyang
    Zhou, Ruixue
    Chen, Jialiang
    Yu, Miao
    Zhang, Wenkai
    Wang, Hongqi
    Sun, Xian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] ENSEMBLE INFERENCE FOR DIFFUSION MODEL-BASED SPEECH ENHANCEMENT
    Shi, Hao
    Kamo, Naoyuki
    Delcroix, Marc
    Nakatani, Tomohiro
    Araki, Shoko
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW 2024, 2024, : 735 - 739
  • [24] CRS-Diff: Controllable Remote Sensing Image Generation With Diffusion Model
    Tang, Datao
    Cao, Xiangyong
    Hou, Xingsong
    Jiang, Zhongyuan
    Liu, Junmin
    Meng, Deyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [25] BSDiff: Low-Light Image Enhancement Via Blueprint Separable Convolution and Wavelet-Diffusion Model
    Shi, Jiajun
    Sang, Qingbing
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 369 - 382
  • [26] Low-Light Image Enhancement with Wavelet-based Diffusion Models
    Jiang, Hai
    Luo, Ao
    Fan, Haoqiang
    Han, Songchen
    Liu, Shuaicheng
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (06):
  • [27] ReCoRo: Region-Controllable Robust Light Enhancement with User-Specified Imprecise Masks
    Xu, Dejia
    Poghosyan, Hayk
    Navasardyan, Shant
    Jiang, Yifan
    Shi, Humphrey
    Wang, Zhangyang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1376 - 1386
  • [28] Controllable fashion rendering via brownian bridge diffusion model with latent sketch encoding
    Wang, Zengmao
    Li, Jituo
    Gao, Wei
    VISUAL COMPUTER, 2025,
  • [29] LLDE: ENHANCING LOW-LIGHT IMAGES WITH DIFFUSION MODEL
    Ooi, Xin Peng
    Chan, Chee Seng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1305 - 1309
  • [30] PixRevive: Latent Feature Diffusion Model for Compressed Video Quality Enhancement
    Wang, Weiran
    Jing, Minge
    Fan, Yibo
    Weng, Wei
    SENSORS, 2024, 24 (06)