BGFlow: Brightness-guided normalizing flow for low-light image enhancement

被引:3
作者
Chen, Jiale [1 ,2 ]
Lian, Qiusheng [1 ]
Shi, Baoshun [1 ,2 ]
机构
[1] Yanshan Univ, Sch Informat Sci & Engn, Qinhuang Dao 066004, Peoples R China
[2] Yanshan Univ, Hebei Key Lab Informat Transmiss & Signal Proc, Qinhuang Dao 066004, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning method; Low-light image enhancement; Normalizing flow; Wavelet transform; Brightness features; Underwater image enhancement; QUALITY ASSESSMENT; HISTOGRAM EQUALIZATION; NETWORK;
D O I
10.1016/j.displa.2024.102863
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Low-light image enhancement poses significant challenges due to its ill-posed nature. Recently, deep learning- based methods have attempted to establish a unified mapping relationship between normal-light images and their low-light versions but frequently struggle to capture the intricate variations in brightness conditions. As a result, these methods often suffer from overexposure, underexposure, amplified noise, and distorted colors. To tackle these issues, we propose a brightness-guided normalizing flow framework, dubbed BGFlow, for low- light image enhancement. Specifically, we recognize that low-frequency sub-bands in the wavelet domain carry significant brightness information. To effectively capture the intricate variations in brightness within an image, we design a transformer-based multi-scale wavelet-domain encoder to extract brightness information from the multi-scale features of the low-frequency sub-bands. The extracted brightness feature maps, at different scales, are then injected into the brightness-guided affine coupling layer to guide the training of the conditional normalizing flow module. Extensive experimental evaluations demonstrate the superiority of BGFlow over existing deep learning-based approaches in both qualitative and quantitative assessments. Moreover, we also showcase the exceptional performance of BGFlow on the underwater image enhancement task.
引用
收藏
页数:12
相关论文
共 56 条
[1]   StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows [J].
Abdal, Rameen ;
Zhu, Peihao ;
Mitra, Niloy J. ;
Wonka, Peter .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (03)
[2]   Noise Flow: Noise Modeling with Conditional Normalizing Flows [J].
Abdelhamed, Abdelrahman ;
Brubaker, Marcus A. ;
Brown, Michael S. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3165-3173
[3]   A dynamic histogram equalization for image contrast enhancement [J].
Abdullah-Al-Wadud, M. ;
Kabir, Md. Hasanul ;
Dewan, M. Ali Akber ;
Chae, Oksam .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (02) :593-600
[4]  
Ardizzone L, 2019, Arxiv, DOI arXiv:1907.02392
[5]   Conditional Invertible Neural Networks for Diverse Image-to-Image Translation [J].
Ardizzone, Lynton ;
Kruse, Jakob ;
Lueth, Carsten ;
Bracher, Niels ;
Rother, Carsten ;
Koethe, Ullrich .
PATTERN RECOGNITION, DAGM GCPR 2020, 2021, 12544 :373-387
[6]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[7]   Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement [J].
Cai, Yuanhao ;
Bian, Hao ;
Lin, Jing ;
Wang, Haoqian ;
Timofte, Radu ;
Zhang, Yulun .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :12470-12479
[8]   An improved image enhancement framework based on multiple attention mechanism [J].
Chen, Qili ;
Fan, Junfang ;
Chen, Wenbai .
DISPLAYS, 2021, 70
[9]  
Chen XL, 2021, Arxiv, DOI [arXiv:2101.00991, DOI 10.48550/ARXIV.2101.00991]
[10]   PPformer: Using pixel-wise and patch-wise cross-attention for low-light image enhancement [J].
Dang, Jiachen ;
Zhong, Yong ;
Qin, Xiaolin .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241