Pre-trained low-light image enhancement transformer

被引:1
|
作者
Zhang, Jingyao [1 ,2 ]
Hao, Shijie [1 ,2 ]
Rao, Yuan [3 ]
机构
[1] Hefei Univ Technol, Key Lab Knowledge Engn Big Data, Minist Educ, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei, Peoples R China
[3] Anhui Agr Univ, Sch Informat & Artificial Intelligence, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
image enhancement; image processing; REPRESENTATION;
D O I
10.1049/ipr2.13076
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement is a longstanding challenge in low-level vision, as images captured in low-light conditions often suffer from significant aesthetic quality flaws. Recent methods based on deep neural networks have made impressive progress in this area. In contrast to mainstream convolutional neural network (CNN)-based methods, an effective solution inspired by the transformer, which has shown impressive performance in various tasks, is proposed. This solution is centred around two key components. The first is an image synthesis pipeline, and the second is a powerful transformer-based pre-trained model, known as the low-light image enhancement transformer (LIET). The image synthesis pipeline includes illumination simulation and realistic noise simulation, enabling the generation of more life-like low-light images to overcome the issue of data scarcity. LIET combines streamlined CNN-based encoder-decoders with a transformer body, efficiently extracting global and local contextual features at a relatively low computational cost. The extensive experiments show that this approach is highly competitive with current state-of-the-art methods. The codes have been released and are available at . An effective transformer-based low-light image enhancement solution called low-light image enhancement transformer, pre-trained on a large synthesized low/normal light image dataset, which achieves state-of-the-art performance, is proposed. The model combines convolutional neural network and transformer architectures for robust feature extraction at low cost and improved generalization capability. image
引用
收藏
页码:1967 / 1984
页数:18
相关论文
共 50 条
  • [1] Underwater Image Enhancement Using Pre-trained Transformer
    Boudiaf, Abderrahmene
    Guo, Yuhang
    Ghimire, Adarsh
    Werghi, Naoufel
    De Masi, Giulia
    Javed, Sajid
    Dias, Jorge
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT III, 2022, 13233 : 480 - 488
  • [2] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [3] LET: a local enhancement transformer for low-light image enhancement
    Pan, Lei
    Tian, Jun
    Zheng, Yuan
    Fu, Qiang
    Zhao, Zhiqing
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [4] LIELFormer: Low-Light Image Enhancement with a Lightweight Transformer
    Zhao, Wei
    Xie, Zhaoyang
    Huang, Lina
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 489 - 500
  • [5] Adaptive lightweight Transformer network for low-light image enhancement
    Meng, De
    Lei, Zhichun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (6-7) : 5365 - 5375
  • [6] A Transformer Network Combing CBAM for Low-Light Image Enhancement
    Sun, Zhefeng
    Wang, Chen
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 5205 - 5220
  • [7] Patch-Based Transformer for Low-Light Image Enhancement
    Zhang, Yu
    Jiang, Shan
    Tang, Xiangyun
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 268 - 273
  • [8] Low-light image enhancement based on Transformer and CNN architecture
    Chen, Keyuan
    Chen, Bin
    Wu, Shiqian
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3628 - 3633
  • [9] RawFormer: An Efficient Vision Transformer for Low-Light RAW Image Enhancement
    Xu, Wanyan
    Dong, Xingbo
    Ma, Lan
    Teoh, Andrew Beng Jin
    Lin, Zhixian
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2677 - 2681
  • [10] Low-Light Image Enhancement by Combining Transformer and Convolutional Neural Network
    Yuan, Nianzeng
    Zhao, Xingyun
    Sun, Bangyong
    Han, Wenjia
    Tan, Jiahai
    Duan, Tao
    Gao, Xiaomei
    MATHEMATICS, 2023, 11 (07)