CLE Diffusion: Controllable Light Enhancement Diffusion Model

被引:16
|
作者
Yin, Yuyang [1 ]
Xu, Dejia [2 ]
Tan, Chuangchuang [1 ]
Liu, Ping [3 ]
Zhao, Yao [1 ]
Wei, Yunchao [1 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing Key Lab Adv Informat Sci & Network, Beijing, Peoples R China
[2] Univ Texas Austin, VITA Grp, Austin, TX USA
[3] ASTAR, IHPC, Ctr Frontier AI Res, Singapore, Singapore
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
关键词
image processing; low light image enhancement; diffusion model; ILLUMINATION; RETINEX;
D O I
10.1145/3581783.3612145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low light enhancement has gained increasing importance with the rapid development of visual creation and editing. However, most existing enhancement algorithms are designed to homogeneously increase the brightness of images to a pre-defined extent, limiting the user experience. To address this issue, we propose Controllable Light Enhancement Diffusion Model, dubbed CLE Diffusion, a novel diffusion framework to provide users with rich controllability. Built with a conditional diffusion model, we introduce an illumination embedding to let users control their desired brightness level. Additionally, we incorporate the Segment-Anything Model (SAM) to enable user-friendly region controllability, where users can click on objects to specify the regions they wish to enhance. Extensive experiments demonstrate that CLE Diffusion achieves competitive performance regarding quantitative metrics, qualitative results, and versatile controllability. Project page: https://yuyangyin.github.io/CLEDiffusion/
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [1] Low Light Image Enhancement Based on Retinex Theory and Diffusion Model
    Chen, Tao
    Liu, Dongmei
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING, ICDSP 2024, 2024, : 21 - 26
  • [2] AnlightenDiff: Anchoring Diffusion Probabilistic Model on Low Light Image Enhancement
    Chan, Cheuk-Yiu
    Siu, Wan-Chi
    Chan, Yuk-Hee
    Chan, H. Anthony
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6324 - 6339
  • [3] Image Intrinsic Components Guided Conditional Diffusion Model for Low-Light Image Enhancement
    Kang, Sicong
    Gao, Shuaibo
    Wu, Wenhui
    Wang, Xu
    Wang, Shuoyao
    Qiu, Guoping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13244 - 13256
  • [4] PSC diffusion: patch-based simplified conditional diffusion model for low-light image enhancement
    Wan, Fei
    Xu, Bingxin
    Pan, Weiguo
    Liu, Hongzhe
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [5] Low Light Enhancement in Street Scenes Based on Diffusion Model
    Xia, Rui
    Wang, Lisong
    Li, Taili
    Shi, Pingping
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1491 - 1496
  • [6] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [7] CAGEN: CONTROLLABLE ANOMALY GENERATOR USING DIFFUSION MODEL
    Jiang, Bolin
    Xie, Yuqiu
    Li, Jiawei
    Li, Naiqi
    Jiang, Yong
    Xia, Shu-Tao
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3110 - 3114
  • [8] LL-Diff: Low-Light Image Enhancement Utilizing Langevin Sampling Diffusion
    Ding, Boren
    Zhang, Xiaofeng
    Yu, Zekun
    Hui, Zheng
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2024,
  • [9] Low-Light Image Enhancement Based on Maximal Diffusion Values
    Kim, Wonjun
    Lee, Ryong
    Park, Minwoo
    Lee, Sang-Hwan
    IEEE ACCESS, 2019, 7 : 129150 - 129163
  • [10] L2DM: A Diffusion Model for Low-Light Image Enhancement
    Lv, Xingguo
    Dong, Xingbo
    Jin, Zhe
    Zhang, Hui
    Song, Siyi
    Li, Xuejun
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 130 - 145