Single-image super-resolution reconstruction based on phase-aware visual multi-layer perceptron (MLP)

被引:0
作者
Shi, Changteng [1 ]
Li, Mengjun [1 ]
An, Zhiyong [1 ]
机构
[1] Shandong Technol & Business Univ, Yantai, Peoples R China
关键词
Super-resolution reconstruction; MLP; Deep learning;
D O I
10.7717/peerj-cs.2208
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many advanced super-resolution reconstruction methods have been proposed recently, but they often require high computational and memory resources, making them incompatible with low-power devices in reality. To address this problem, we propose a simple yet efficient super-resolution reconstruction method using waveform representation and multi-layer perceptron (MLP) for image processing. Firstly, we partition the original image and its down-sampled version into multiple patches and introduce WaveBlock to process these patches. WaveBlock represents patches as waveform functions with amplitude and phase and extracts representative feature representations by dynamically adjusting phase terms between tokens and fixed weights. Next, we fuse the extracted features through a feature fusion block and finally reconstruct the image using sub-pixel convolution. Extensive experimental results demonstrate that SRWave-MLP performs excellently in both quantitative evaluation metrics and visual quality while having significantly fewer parameters than state-of-the-art efficient superresolution methods.
引用
收藏
页数:23
相关论文
共 50 条
[41]   Single image super-resolution reconstruction based on multi-scale feature mapping adversarial network [J].
Zhou, Dengwen ;
Duan, Ran ;
Zhao, Lijuan ;
Chai, Xiaoliang .
SIGNAL PROCESSING, 2020, 166
[42]   Deep artifact-free residual network for single-image super-resolution [J].
Hamdollah Nasrollahi ;
Kamran Farajzadeh ;
Vahid Hosseini ;
Esmaeil Zarezadeh ;
Milad Abdollahzadeh .
Signal, Image and Video Processing, 2020, 14 :407-415
[43]   Multi-Scale Residual Fusion Network for Super-Resolution Reconstruction of Single Image [J].
Zhao, Baiting ;
Hu, Rui ;
Jia, Xiaofen ;
Guo, Yongcun .
IEEE ACCESS, 2020, 8 :155285-155295
[44]   Single Image Super-resolution Reconstruction with Wavelet based Deep Residual Learning [J].
Dou, Jianfang ;
Tu, Zimei ;
Peng, Xishuai .
PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, :4270-4275
[45]   A Review of Single Image Super-resolution Reconstruction Algorithms Based on Deep Learning [J].
Li J.-X. ;
Zhao Y.-X. ;
Wang J.-H. .
Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (10) :2341-2363
[46]   Infrared small target detection based on the combination of single image super-resolution reconstruction and YOLOX [J].
Wang Zhiyong ;
Xiang Xuefu ;
Zeng Kan ;
Zhang Zhenyu ;
Li Yanan ;
Song Dengpan .
2023 2ND ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING, CACML 2023, 2023, :547-552
[47]   Image Super-resolution Reconstruction Algorithm Based on Clustering [J].
Zhao Xiaoqiang ;
Jia Yunxia .
2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, :6144-6148
[48]   An Image Super-Resolution Reconstruction Method Based on PEGAN [J].
Jing, Chang-Wei ;
Huang, Zhi-Xing ;
Ling, Zai-Ying .
IEEE ACCESS, 2023, 11 :102550-102561
[49]   A Gated Deep Model for Single Image Super-Resolution Reconstruction [J].
Qaderi, Nahid ;
Saeedi, Parvaneh .
2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
[50]   Training-Free, Single-Image Super-Resolution Using a Dynamic Convolutional Network [J].
Bhowmik, Aritra ;
Shit, Suprosanna ;
Seelamantula, Chandra Sekhar .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (01) :85-89