Improved wavelet prediction superresolution reconstruction based on U-Net

被引:0
作者
Cao, Jianfang [1 ,2 ]
Chen, Zeyu [1 ,2 ]
Cui, Hongyan [1 ]
Ji, Xiaofei [2 ,3 ]
Wang, Xianhui [1 ,2 ]
Liang, Yunchuan [2 ]
Tian, Yun [2 ]
机构
[1] Taiyuan Univ Sci & Technol, Sch Comp Sci & Technol, Taiyuan, Peoples R China
[2] Xinzhou Normal Univ, Dept Comp Sci & Technol, Xinzhou, Peoples R China
[3] INTI Int Univ, Fac Business Commun & Law, Persiaran Perdana BBN, Sembilan, Malaysia
关键词
channel attention; convolutional neural network; deep learning; single-image superresolution; wavelet transform; IMAGE SUPERRESOLUTION; CONVOLUTIONAL NETWORK;
D O I
10.1049/ipr2.12878
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning can be used to achieve single-image superresolution (SR) reconstruction. To address problems encountered during this process, such as the number of network parameters, high training requirements on equipment performance, and inability to downsample certain SR images accurately, an image SR reconstruction algorithm based on deep residual network optimization is proposed. The model introduces wavelet transforms based on the original U-Net, where the U-Net is trained to obtain SR wavelet feature images at multiple scales simultaneously. This approach reduces the mapping space for the network to learn low- to high-resolution image mapping, which in turn reduces the training difficulty of the model. In terms of network details, the inverse wavelet transform is used in image upsampling to enhance the sparsity of the reconstruction layer in the original network. The network structure of the U-Net upsampling is adjusted slightly to enable the network to distinguish wavelet images from feature images, thereby improving the richness of the features extracted by the model. The experimental results show that the peak signal-to-noise ratio (PSNR) of the fourfold SR model is 32.35 and 28.68 on the Set5 and Set14 validation sets, respectively. Compared with networks that use wavelet prediction mechanisms, such as the deep wavelet prediction SR (DWSR) and deep wavelet prediction-based residual SR (DWRSR) models, the PSNR for all the tested public datasets is improved by 0.5. The method yields superior results in terms of both visual effect and PSNR, demonstrating the feasibility of the wavelet prediction mechanism in SR reconstruction and thus offering application value and research significance.
引用
收藏
页码:3464 / 3476
页数:13
相关论文
共 31 条
[1]   Contour Detection and Hierarchical Image Segmentation [J].
Arbelaez, Pablo ;
Maire, Michael ;
Fowlkes, Charless ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) :898-916
[2]  
Bertasius G, 2021, PR MACH LEARN RES, V139
[3]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[4]  
Bilgazyev E., 2011, Biometrics, International Joint Conference on, P1
[5]   Edge Intelligence Empowered Vehicle Detection and Image Segmentation for Autonomous Vehicles [J].
Chen, Chen ;
Wang, Chenyu ;
Liu, Bin ;
He, Ci ;
Cong, Li ;
Wan, Shaohua .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (11) :13023-13034
[6]   Two Path Gland Segmentation Algorithm of Colon Pathological Image Based on Local Semantic Guidance [J].
Ding, Songtao ;
Wang, Hongyu ;
Lu, Hu ;
Nappi, Michele ;
Wan, Shaohua .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (04) :1701-1708
[7]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[8]  
Duan Li-Juan, 2019, Journal of Software, V30, P941, DOI 10.13328/j.cnki.jos.005663
[9]   Multimodal Multi-Head Convolutional Attention with Various Kernel Sizes for Medical Image Super-Resolution [J].
Georgescu, Mariana-Iuliana ;
Ionescu, Radu Tudor ;
Miron, Andreea-Iuliana ;
Savencu, Olivian ;
Ristea, Nicolae-Catalin ;
Verga, Nicolae ;
Khan, Fahad Shahbaz .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :2194-2204
[10]  
Gong Z, 2017, 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL ELECTROMAGNETICS (ICCEM), P104, DOI 10.1109/COMPEM.2017.7912793