TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement

被引:3
作者
Zhang, Wanjun [1 ]
Ding, Yujie [2 ]
Zhang, Miaohui [2 ]
Zhang, Yonghua [2 ]
Cao, Lvchen [2 ]
Huang, Ziqing [2 ]
Wang, Jun [2 ]
机构
[1] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475001, Peoples R China
[2] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Transformer; Transformer-CNN; ILLUMINATION;
D O I
10.1007/s11042-023-17527-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning has made impressive achievements in low-light image enhancement. Most existing deep learning-based methods use convolutional neural networks (CNN) by stacking network depth and modifying network architecture to improve feature extraction capabilities and restore degraded images. However, these methods have obvious defects. Although CNN excels at extracting local features, its small receptive field is unable to capture the global brightness, leading to overexposure. The Transformer model from natural language processing has recently produced positive outcomes in a variety of computer vision issues thanks to its excellent global modeling capabilities. However, its complex modeling method makes it difficult to capture local details and takes up many computing resources, making it challenging to apply to the enhancement of low-light images, especially high-resolution images. Based on deep convolution and Transformer characteristics, this paper proposes a Transformer-CNN Parallel Cooperative Network (TCPCNet), which supplements image details and local brightness while ensuring global brightness control. We also changed the calculation method of the traditional Transformer to be applied to enhance high-resolution low-light images without affecting performance. Extensive experiments on public datasets show that the proposed TCPCNet achieves comparable performance against the state-of-the-art approaches.
引用
收藏
页码:52957 / 52972
页数:16
相关论文
共 40 条
  • [1] Carion N, 2020, European conference on computer vision, P213, DOI DOI 10.1007/978-3-030-58452-813
  • [2] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [3] Integrating Semantic Segmentation and Retinex Model for Low Light Image Enhancement
    Fan, Minhao
    Wang, Wenjing
    Yang, Wenhan
    Liu, Jiaying
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2317 - 2325
  • [4] A weighted variational model for simultaneous reflectance and illumination estimation
    Fu, Xueyang
    Zeng, Delu
    Huang, Yue
    Zhang, Xiao-Ping
    Ding, Xinghao
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2782 - 2790
  • [5] A fusion-based enhancing method for weakly illuminated images
    Fu, Xueyang
    Zeng, Delu
    Huang, Yue
    Liao, Yinghao
    Ding, Xinghao
    Paisley, John
    [J]. SIGNAL PROCESSING, 2016, 129 : 82 - 96
  • [6] A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation
    Fu, Xueyang
    Liao, Yinghao
    Zeng, Delu
    Huang, Yue
    Zhang, Xiao-Ping
    Ding, Xinghao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) : 4965 - 4977
  • [7] Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement
    Guo, Chunle
    Li, Chongyi
    Guo, Jichang
    Loy, Chen Change
    Hou, Junhui
    Kwong, Sam
    Cong, Runmin
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1777 - 1786
  • [8] LIME: Low-Light Image Enhancement via Illumination Map Estimation
    Guo, Xiaojie
    Li, Yu
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) : 982 - 993
  • [9] Visualization of Convolutional Neural Networks for Monocular Depth Estimation
    Hu, Junjie
    Zhang, Yan
    Okatani, Takayuki
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3868 - 3877
  • [10] Scope of validity of PSNR in image/video quality assessment
    Huynh-Thu, Q.
    Ghanbari, M.
    [J]. ELECTRONICS LETTERS, 2008, 44 (13) : 800 - U35