FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information

被引:47
作者
Wang, Chenxi [1 ]
Wu, Hongjun [1 ]
Jin, Zhi [1 ,2 ,3 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Guangdong Prov Key Lab Fire Sci & Technol, Guangzhou, Peoples R China
[3] Guangdong Prov Key Lab Robot Digital Intelligent, Guangzhou, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Fourier frequency information; Amplitude transform map; Signal-to-noise-ratio map; QUALITY ASSESSMENT; RETINEX; ALGORITHM; NETWORK;
D O I
10.1145/3581783.3611909
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, Fourier frequency information has attracted much attention in Low-Light Image Enhancement (LLIE). Some researchers noticed that, in the Fourier space, the lightness degradation mainly exists in the amplitude component and the rest exists in the phase component. By incorporating both the Fourier frequency and the spatial information, these researchers proposed remarkable solutions for LLIE. In this work, we further explore the positive correlation between the magnitude of amplitude and the magnitude of lightness, which can be effectively leveraged to improve the lightness of low-light images in the Fourier space. Moreover, we find that the Fourier transform can extract the global information of the image, and does not introduce massive neural network parameters like Multi-Layer Perceptrons (MLPs) or Transformer. To this end, a two-stage Fourier-based LLIE network (FourLLIE) is proposed. In the first stage, we improve the lightness of low-light images by estimating the amplitude transform map in the Fourier space. In the second stage, we introduce the Signal-to-Noise-Ratio (SNR) map to provide the prior for integrating the global Fourier frequency and the local spatial information, which recovers image details in the spatial space. With this ingenious design, FourLLIE outperforms the existing state-of-the-art (SOTA) LLIE methods on four representative datasets while maintaining good model efficiency. Notably, compared with a recent Transformer-based SOTA method SNR-Aware, FourLLIE reaches superior performance with only 0.31% parameters. Code is available at https://github.com/wangchx67/FourLLIE.
引用
收藏
页码:7459 / 7469
页数:11
相关论文
共 50 条
  • [41] Frequency-guided dual-collapse Transformer for low-light image enhancement
    Lin, Jianpu
    Lai, Fangwei
    Lin, Shanling
    Lin, Zhixian
    Guo, Tailiang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 142
  • [42] LECARM: Low-Light Image Enhancement Using the Camera Response Model
    Ren, Yurui
    Ying, Zhenqiang
    Li, Thomas H.
    Li, Ge
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (04) : 968 - 981
  • [43] Progressive Dual-Branch Network for Low-Light Image Enhancement
    Cui, Hengshuai
    Li, Jinjiang
    Hua, Zhen
    Fan, Linwei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [44] Low-light image enhancement based on virtual exposure
    Wang, Wencheng
    Yan, Dongliang
    Wu, Xiaojin
    He, Weikai
    Chen, Zhenxue
    Yuan, Xiaohui
    Li, Lun
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 118
  • [45] Bilateral fusion low-light image enhancement with implicit information constraints
    Zhu, Jiahui
    Sang, Shengbo
    Jian, Aoqun
    Yang, Le
    Sang, Luxiao
    Ge, Yang
    Kang, Rihui
    Yang, LiuWei
    Tao, Lei
    Hao, RunFang
    IET IMAGE PROCESSING, 2024, 18 (13) : 4141 - 4150
  • [46] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [47] Illumination Guided Attentive Wavelet Network for Low-Light Image Enhancement
    Xu, Jingzhao
    Yuan, Mengke
    Yan, Dong-Ming
    Wu, Tieru
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6258 - 6271
  • [48] Dual-band low-light image enhancement
    Mi, Aizhong
    Luo, Wenhui
    Huo, Zhanqiang
    MULTIMEDIA SYSTEMS, 2024, 30 (02)
  • [49] Adaptive Low-Light Image Enhancement with Decomposition Denoising
    Gao, Yin
    Yan, Chao
    Zeng, Huixiong
    Li, Qiming
    Li, Jun
    2022 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION ENGINEERING, ICRAE, 2022, : 332 - 336
  • [50] Low-light image enhancement with geometrical sparse representation
    Tan, Jin
    Zhang, Taiping
    Zhao, Linchang
    Huang, Darong
    Zhang, Zhenyuan
    APPLIED INTELLIGENCE, 2023, 53 (09) : 11019 - 11033