FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information

被引:47
|
作者
Wang, Chenxi [1 ]
Wu, Hongjun [1 ]
Jin, Zhi [1 ,2 ,3 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Guangdong Prov Key Lab Fire Sci & Technol, Guangzhou, Peoples R China
[3] Guangdong Prov Key Lab Robot Digital Intelligent, Guangzhou, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Fourier frequency information; Amplitude transform map; Signal-to-noise-ratio map; QUALITY ASSESSMENT; RETINEX; ALGORITHM; NETWORK;
D O I
10.1145/3581783.3611909
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, Fourier frequency information has attracted much attention in Low-Light Image Enhancement (LLIE). Some researchers noticed that, in the Fourier space, the lightness degradation mainly exists in the amplitude component and the rest exists in the phase component. By incorporating both the Fourier frequency and the spatial information, these researchers proposed remarkable solutions for LLIE. In this work, we further explore the positive correlation between the magnitude of amplitude and the magnitude of lightness, which can be effectively leveraged to improve the lightness of low-light images in the Fourier space. Moreover, we find that the Fourier transform can extract the global information of the image, and does not introduce massive neural network parameters like Multi-Layer Perceptrons (MLPs) or Transformer. To this end, a two-stage Fourier-based LLIE network (FourLLIE) is proposed. In the first stage, we improve the lightness of low-light images by estimating the amplitude transform map in the Fourier space. In the second stage, we introduce the Signal-to-Noise-Ratio (SNR) map to provide the prior for integrating the global Fourier frequency and the local spatial information, which recovers image details in the spatial space. With this ingenious design, FourLLIE outperforms the existing state-of-the-art (SOTA) LLIE methods on four representative datasets while maintaining good model efficiency. Notably, compared with a recent Transformer-based SOTA method SNR-Aware, FourLLIE reaches superior performance with only 0.31% parameters. Code is available at https://github.com/wangchx67/FourLLIE.
引用
收藏
页码:7459 / 7469
页数:11
相关论文
共 50 条
  • [31] Low-Light Image Enhancement Network Based on Recursive Network
    Liu, Fangjin
    Hua, Zhen
    Li, Jinjiang
    Fan, Linwei
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [32] Low-Light Image Enhancement Using the Cell Vibration Model
    Lei, Xiaozhou
    Fei, Zixiang
    Zhou, Wenju
    Zhou, Huiyu
    Fei, Minrui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 4439 - 4454
  • [33] Contextual Information Aided Generative Adversarial Network for Low-Light Image Enhancement
    Hu, Shiyong
    Yan, Jia
    Deng, Dexiang
    ELECTRONICS, 2022, 11 (01)
  • [34] An Empirical Study on Retinex Methods for Low-Light Image Enhancement
    Rasheed, Muhammad Tahir
    Guo, Guiyu
    Shi, Daming
    Khan, Hufsa
    Cheng, Xiaochun
    REMOTE SENSING, 2022, 14 (18)
  • [35] Lightening Network for Low-Light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel P. K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7984 - 7996
  • [36] LightingNet: An Integrated Learning Method for Low-Light Image Enhancement
    Yang, Shaoliang
    Zhou, Dongming
    Cao, Jinde
    Guo, Yanbu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 29 - 42
  • [37] A Joint Network for Low-Light Image Enhancement Based on Retinex
    Jiang, Yonglong
    Zhu, Jiahe
    Li, Liangliang
    Ma, Hongbing
    COGNITIVE COMPUTATION, 2024, 16 (06) : 3241 - 3259
  • [38] Low-Light Hyperspectral Image Enhancement
    Li, Xuelong
    Li, Guanlin
    Zhao, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] Low-light image enhancement based on normal-light image degradation
    Zhao, Bai
    Gong, Xiaolin
    Wang, Jian
    Zhao, Lingchao
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (05) : 1409 - 1416
  • [40] Low-light image enhancement using inverted image normalized by atmospheric light
    Jeon, Jong Ju
    Eom, I. I. Kyu
    SIGNAL PROCESSING, 2022, 196