Revisiting coarse-to-fine strategy for low-light image enhancement with deep decomposition guided training

被引:5
作者
Jiang, Hai [1 ]
Ren, Yang [1 ]
Han, Songchen [1 ]
机构
[1] Sichuan Univ, Sch Aeronaut & Astronaut, Chengdu 610065, Peoples R China
关键词
Low-light image enhancement; Coarse-to-fine restoration; Light-head and heavy-tail network; Retinex theory; QUALITY ASSESSMENT; NETWORK;
D O I
10.1016/j.cviu.2024.103952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Previous coarse -to -fine strategies typically spend equal effort in feature extraction and feature reconstruction, and gradually improve the brightness of images from bottom to top, resulting in computational resources not being well consumed for restoration. In this paper, we propose a new deep framework for Robust and Fast Low -Light Image Enhancement, dubbed RFLLIE. Specifically, we first use a lightweight CNN encoder consisting of a few convolutional layers and pooling layers to form a feature pyramid for restoration. Then, a coarseto -fine recovery module, which consists of cascaded depth blocks and well -designed spatial attention layers as well as progressive dilation Resblocks, is proposed for feature aggregation and global -to -local restoration. As such, our RFLLIE is formed as a light -head and heavy -tail architecture that focuses more on feature reconstruction rather than extraction. Additionally, we propose a decomposition -guided restoration loss based on the Retinex theory that adopts the "enhancement before decomposition"strategy instead of the commonly used "decomposition before enhancement'' to further improve the contrast and suppress noise. Extensive experiments demonstrate that our method outperforms the existing state-of-the-art methods both quantitatively and visually, and achieves a better trade-off between performance and efficiency. Our code will be available at https://github.com/JianghaiSCU/RFLLIE.
引用
收藏
页数:12
相关论文
共 74 条
[1]   Fully synthetic training for image restoration tasks [J].
Achddou, Raphael ;
Gousseau, Yann ;
Ladjal, Said .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
[2]   An Augmented Lagrangian Method for Total Variation Video Restoration [J].
Chan, Stanley H. ;
Khoshabeh, Ramsin ;
Gibson, Kristofor B. ;
Gill, Philip E. ;
Nguyen, Truong Q. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (11) :3097-3111
[3]   Learning to See in the Dark [J].
Chen, Chen ;
Chen, Qifeng ;
Xu, Jia ;
Koltun, Vladlen .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3291-3300
[4]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[5]  
Dosovitskiy A., 2021, 9 INT C LEARN REPR I
[6]   Multiscale Low-Light Image Enhancement Network With Illumination Constraint [J].
Fan, Guo-Dong ;
Fan, Bi ;
Gan, Min ;
Chen, Guang-Yong ;
Chen, C. L. Philip .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) :7403-7417
[7]   Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement [J].
Fan, Minhao ;
Wang, Wenjing ;
Yang, Wenhan ;
Liu, Jiaying .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :2317-2325
[8]   Learning deep edge prior for image denoising [J].
Fang, Yingying ;
Zeng, Tieyong .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 200
[9]   You Do Not Need Additional Priors or Regularizers in Retinex-based Low-light Image Enhancement [J].
Fu, Huiyuan ;
Zheng, Wenkai ;
Meng, Xiangyu ;
Wang, Xin ;
Wang, Chuanming ;
Ma, Huadong .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :18125-18134
[10]   A weighted variational model for simultaneous reflectance and illumination estimation [J].
Fu, Xueyang ;
Zeng, Delu ;
Huang, Yue ;
Zhang, Xiao-Ping ;
Ding, Xinghao .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2782-2790