High-Magnification Super-Resolution Reconstruction of Image with Multi-Task Learning

被引:3
|
作者
Li, Yanghui [1 ]
Zhu, Hong [1 ]
Yu, Shunyuan [2 ]
机构
[1] Xian Univ Technol, Fac Automat & Informat Engn, Xian 710048, Peoples R China
[2] Ankang Univ, Inst Elect & Informat Engn, Ankang 725000, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-task learning; high-magnification; single-image super-resolution; convolutional neural network; QUALITY ASSESSMENT; NETWORK;
D O I
10.3390/electronics11091412
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single-image super-resolution technology has made great progress with the development of the convolutional neural network, but most of the current super-resolution methods do not attempt high-magnification image super-resolution reconstruction; only reconstruction with x 2, x 3, x 4 magnification is carried out for low-magnification down-sampled images without serious degradation. Based on this, this paper proposed a single-image high-magnification super-resolution method, which extends the scale factor of image super-resolution to high magnification. By introducing the idea of multi-task learning, the process of the high-magnification image super-resolution process is decomposed into different super-resolution tasks. Different tasks are trained with different data, and network models for different tasks can be obtained. Through the cascade reconstruction of different task network models, a low-resolution image accumulates reconstruction advantages layer by layer, and we obtain the final high-magnification super-resolution reconstruction results. The proposed method shows better performance in quantitative and qualitative comparison on the benchmark dataset than other super-resolution methods.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] MMSRNet: Pathological image super-resolution by multi-task and multi-scale learning
    Wu, Xinyue
    Chen, Zhineng
    Peng, Changgen
    Ye, Xiongjun
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 81
  • [2] Improvement of Text Image Super-Resolution Benefiting Multi-task Learning
    Honda, Kosuke
    Fujita, Hamido
    Kurematsu, Masaki
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: THEORY AND PRACTICES IN ARTIFICIAL INTELLIGENCE, 2022, 13343 : 275 - 286
  • [3] Multi-Category Image Super-Resolution with Convolutional Neural Network and Multi-Task Learning
    Urazoe, Kazuya
    Kuroki, Nobutaka
    Kato, Yu
    Ohtani, Shinya
    Hirose, Tetsuya
    Numa, Masahiro
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (01) : 183 - 193
  • [4] Multi-Task Learning for Scene Text Image Super-Resolution with Multiple Transformers
    Honda, Kosuke
    Kurematsu, Masaki
    Fujita, Hamido
    Selamat, Ali
    ELECTRONICS, 2022, 11 (22)
  • [5] Multi-task Learning-based All-in-one Collaboration Framework for Degraded Image Super-resolution
    Jin, Xin
    Xu, Jianfeng
    Tasaka, Kazuyuki
    Chen, Zhibo
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (01)
  • [6] A New Super Resolution Framework Based on Multi-Task Learning for Remote Sensing Images
    Yan, Li
    Chang, Kun
    SENSORS, 2021, 21 (05) : 1 - 20
  • [7] RIRGAN: An end-to-end lightweight multi-task learning method for brain MRI super-resolution and denoising
    Yu, Miao
    Guo, Miaomiao
    Zhang, Shuai
    Zhan, Yuefu
    Zhao, Mingkang
    Lukasiewicz, Thomas
    Xu, Zhenghua
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 167
  • [8] FCSR-GAN: Joint Face Completion and Super-Resolution via Multi-Task Learning
    Cai J.
    Han H.
    Shan S.
    Chen X.
    IEEE Transactions on Biometrics, Behavior, and Identity Science, 2020, 2 (02): : 109 - 121
  • [9] Novel Multi-Task Learning for Motion Magnification
    Chen, Li
    Peng, Cong
    Zhao, Bingchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 5973 - 5985
  • [10] Super-resolution for high magnification face images
    Yao, Yi
    Abidi, Besma
    Kalka, Nathan D.
    Schmid, Natalia
    Abidi, Mongi
    BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION IV, 2007, 6539