TCPCNet: a transformer-CNN parallel cooperative network for low-light image enhancement

被引:3
|
作者
Zhang, Wanjun [1 ]
Ding, Yujie [2 ]
Zhang, Miaohui [2 ]
Zhang, Yonghua [2 ]
Cao, Lvchen [2 ]
Huang, Ziqing [2 ]
Wang, Jun [2 ]
机构
[1] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475001, Peoples R China
[2] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Transformer; Transformer-CNN; ILLUMINATION;
D O I
10.1007/s11042-023-17527-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, deep learning has made impressive achievements in low-light image enhancement. Most existing deep learning-based methods use convolutional neural networks (CNN) by stacking network depth and modifying network architecture to improve feature extraction capabilities and restore degraded images. However, these methods have obvious defects. Although CNN excels at extracting local features, its small receptive field is unable to capture the global brightness, leading to overexposure. The Transformer model from natural language processing has recently produced positive outcomes in a variety of computer vision issues thanks to its excellent global modeling capabilities. However, its complex modeling method makes it difficult to capture local details and takes up many computing resources, making it challenging to apply to the enhancement of low-light images, especially high-resolution images. Based on deep convolution and Transformer characteristics, this paper proposes a Transformer-CNN Parallel Cooperative Network (TCPCNet), which supplements image details and local brightness while ensuring global brightness control. We also changed the calculation method of the traditional Transformer to be applied to enhance high-resolution low-light images without affecting performance. Extensive experiments on public datasets show that the proposed TCPCNet achieves comparable performance against the state-of-the-art approaches.
引用
收藏
页码:52957 / 52972
页数:16
相关论文
共 50 条
  • [31] Hierarchical guided network for low-light image enhancement
    Feng, Xiaomei
    Li, Jinjiang
    Fan, Hui
    IET IMAGE PROCESSING, 2021, 15 (13) : 3254 - 3266
  • [32] Deep Lightening Network for Low-light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel Pak-Kong
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [33] Invertible network for unpaired low-light image enhancement
    Zhang, Jize
    Wang, Haolin
    Wu, Xiaohe
    Zuo, Wangmeng
    VISUAL COMPUTER, 2024, 40 (01): : 109 - 120
  • [34] LOW-LIGHT IMAGE ENHANCEMENT USING CNN AND BRIGHT CHANNEL PRIOR
    Tao, Li
    Zhu, Chuang
    Song, Jiawen
    Lu, Tao
    Jia, Huizhu
    Xie, Xiaodong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3215 - 3219
  • [35] Transformer-Based Multi-scale Optimization Network for Low-Light Image Enhancement
    Niu Y.
    Lin X.
    Xu H.
    Li Y.
    Chen Y.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (06): : 511 - 529
  • [36] RawFormer: An Efficient Vision Transformer for Low-Light RAW Image Enhancement
    Xu, Wanyan
    Dong, Xingbo
    Ma, Lan
    Teoh, Andrew Beng Jin
    Lin, Zhixian
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2677 - 2681
  • [37] DEANet: Decomposition Enhancement and Adjustment Network for Low-Light Image Enhancement
    Jiang, Yonglong
    Li, Liangliang
    Zhu, Jiahe
    Xue, Yuan
    Ma, Hongbing
    TSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28 (04): : 743 - 753
  • [38] CSegNet: a hybrid transformer-CNN network for road crack image segmentation
    Dong, Hao
    Du, Yinlai
    Feng, Dong
    Hu, Qingyuan
    Zhou, Mingzhu
    Xing, Jun
    Zhang, Long
    Wang, Shu
    Liu, Yong
    INSIGHT, 2024, 66 (12) : 737 - 746
  • [39] A transformer-CNN for deep image inpainting forensics
    Zhu, Xinshan
    Lu, Junyan
    Ren, Honghao
    Wang, Hongquan
    Sun, Biao
    VISUAL COMPUTER, 2023, 39 (10): : 4721 - 4735
  • [40] A deep Retinex network for underwater low-light image enhancement
    Ji, Kai
    Lei, Weimin
    Zhang, Wei
    MACHINE VISION AND APPLICATIONS, 2023, 34 (06)