Joint low-light enhancement and deblurring with structural priors guidance

被引:2
作者
Ye, Jing [1 ]
Yang, Linjie [1 ]
Qiu, Changzhen [1 ]
Zhang, Zhiyong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen 518107, Guangdong, Peoples R China
关键词
Low-light enhancement; Deblurring; Structural prior; Deep learning; DYNAMIC HISTOGRAM EQUALIZATION; QUALITY ASSESSMENT; IMAGE-ENHANCEMENT; REPRESENTATION; ILLUMINATION;
D O I
10.1016/j.eswa.2024.123722
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Images captured under low-light conditions usually co-exist with low light and blur degradation. Most existing cascade and joint enhancement methods may provide undesirable results, suffering from severe artifacts, deteriorating blur, and unclear details. In this paper, we propose a novel network with structural priors, including high-frequency and edge, to enable effective image representation learning for joint low-light enhancement and deblurring. Specifically, we employ a Transformer backbone to explore the global clues of the image. To compensate for the inadequate local detail optimization, we propose a multi -patch perception pyramid block that models the correlation between different size patches and ambiguity, and identifies non-uniform deblurring spatial features, facilitating the reconstruction of potential high-frequency and edge information. Furthermore, a prior-guided reconstruction block based on the parallel attention mechanism is present to adaptively correct global image with statistical features, which helps guide the model to refine sharp texture and structure. Extensive experiments performed on simulated and real-world datasets demonstrate the efficacy of our proposed method in restoring low-light blurry and low-light images with increased visual perception compared to state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 64 条
[1]   A dynamic histogram equalization for image contrast enhancement [J].
Abdullah-Al-Wadud, M. ;
Kabir, Md. Hasanul ;
Dewan, M. Ali Akber ;
Chae, Oksam .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (02) :593-600
[2]  
[Anonymous], IEEE T PATTERN ANAL, DOI [DOI 10.1109/TPAMI.2021.3063604, 10.1109/TPAMI.2021.3063604]
[3]   Single-Image Blind Deblurring Using Multi-Scale Latent Structure Prior [J].
Bai, Yuanchao ;
Jia, Huizhu ;
Jiang, Ming ;
Liu, Xianming ;
Xie, Xiaodong ;
Gao, Wen .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (07) :2033-2045
[5]   Blind Deblurring for Saturated Images [J].
Chen, Liang ;
Zhang, Jiawei ;
Lin, Songnan ;
Fang, Faming ;
Ren, Jimmy S. .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6304-6312
[6]   Rethinking Coarse-to-Fine Approach in Single Image Deblurring [J].
Cho, Sung-Jin ;
Ji, Seo-Won ;
Hong, Jun-Pyo ;
Jung, Seung-Won ;
Ko, Sung-Jea .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4621-4630
[7]   A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation [J].
Fu, Xueyang ;
Liao, Yinghao ;
Zeng, Delu ;
Huang, Yue ;
Zhang, Xiao-Ping ;
Ding, Xinghao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :4965-4977
[8]   LE-GAN: Unsupervised low-light image enhancement network using attention module and identity invariant loss [J].
Fu, Ying ;
Hong, Yang ;
Chen, Linwei ;
You, Shaodi .
KNOWLEDGE-BASED SYSTEMS, 2022, 240
[9]   Edge-aware deep image deblurring [J].
Fu, Zhichao ;
Zheng, Yingbin ;
Ma, Tianlong ;
Ye, Hao ;
Yang, Jing ;
He, Liang .
NEUROCOMPUTING, 2022, 502 :37-47
[10]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786