Single-image super-resolution reconstruction based on phase-aware visual multi-layer perceptron (MLP)

被引:0
作者
Shi, Changteng [1 ]
Li, Mengjun [1 ]
An, Zhiyong [1 ]
机构
[1] Shandong Technol & Business Univ, Yantai, Peoples R China
关键词
Super-resolution reconstruction; MLP; Deep learning;
D O I
10.7717/peerj-cs.2208
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many advanced super-resolution reconstruction methods have been proposed recently, but they often require high computational and memory resources, making them incompatible with low-power devices in reality. To address this problem, we propose a simple yet efficient super-resolution reconstruction method using waveform representation and multi-layer perceptron (MLP) for image processing. Firstly, we partition the original image and its down-sampled version into multiple patches and introduce WaveBlock to process these patches. WaveBlock represents patches as waveform functions with amplitude and phase and extracts representative feature representations by dynamically adjusting phase terms between tokens and fixed weights. Next, we fuse the extracted features through a feature fusion block and finally reconstruct the image using sub-pixel convolution. Extensive experimental results demonstrate that SRWave-MLP performs excellently in both quantitative evaluation metrics and visual quality while having significantly fewer parameters than state-of-the-art efficient superresolution methods.
引用
收藏
页数:23
相关论文
共 50 条
[21]   A fast deconvolution-based approach for single-image super-resolution with GPU acceleration [J].
Cheolkon Jung ;
Peng Ke ;
Zengzeng Sun ;
Aiguo Gu .
Journal of Real-Time Image Processing, 2018, 14 :501-512
[22]   A fast deconvolution-based approach for single-image super-resolution with GPU acceleration [J].
Jung, Cheolkon ;
Ke, Peng ;
Sun, Zengzeng ;
Gu, Aiguo .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2018, 14 (02) :501-512
[23]   FPPN: fast pixel purification network for single-image super-resolution [J].
Bin Meng ;
Xiaomin Yang ;
Rongzhu Zhang ;
Kai Liu .
Multimedia Systems, 2022, 28 (1) :281-293
[24]   FPPN: fast pixel purification network for single-image super-resolution [J].
Meng, Bin ;
Yang, Xiaomin ;
Zhang, Rongzhu ;
Liu, Kai .
MULTIMEDIA SYSTEMS, 2022, 28 (01) :281-293
[25]   Comparative Analysis of Quantization Optimizations for Single-Image Super-Resolution Models [J].
Fisne, Alparslan ;
Kalay, Alperen ;
Bilecen, Bahri Batuhan .
32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
[26]   Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction [J].
Daniele Ravì ;
Agnieszka Barbara Szczotka ;
Dzhoshkun Ismail Shakir ;
Stephen P. Pereira ;
Tom Vercauteren .
International Journal of Computer Assisted Radiology and Surgery, 2018, 13 :917-924
[27]   Survey of Learning Based Single Image Super-Resolution Reconstruction Technology [J].
K. Bai ;
X. Liao ;
Q. Zhang ;
X. Jia ;
S. Liu .
Pattern Recognition and Image Analysis, 2020, 30 :567-577
[28]   Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction [J].
Ravi, Daniele ;
Szczotka, Agnieszka Barbara ;
Shakir, Dzhoshkun Ismail ;
Pereira, Stephen P. ;
Vercauteren, Tom .
INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2018, 13 (06) :917-924
[29]   A review of single image super-resolution reconstruction based on deep learning [J].
Yu, Ming ;
Shi, Jiecong ;
Xue, Cuihong ;
Hao, Xiaoke ;
Yan, Gang .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) :55921-55962
[30]   Single Image Super-resolution Reconstruction Algorithm Based on Eage Selection [J].
Zhang, Yaolan ;
Liu, Yijun .
MATERIALS SCIENCE, ENERGY TECHNOLOGY, AND POWER ENGINEERING I, 2017, 1839