Self-Learning Super-Resolution Using Convolutional Principal Component Analysis and Random Matching

被引:10
|
作者
Xu, Jian [1 ]
Li, Meng [1 ]
Fan, Jiulun [1 ]
Zhao, Xiaoqiang [1 ]
Chang, Zhiguo [2 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Shaanxi, Peoples R China
[2] Changan Univ, Sch Informat Engn, Xian 710064, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; random oscillation; neighbor embedding; self-learning; principal component analysis; SINGLE-IMAGE SUPERRESOLUTION; SPARSE REPRESENTATION; INTERPOLATION; PROJECTION;
D O I
10.1109/TMM.2018.2871948
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-learning super-resolution (SLSR) algorithms have the advantage of being independent of an external training database. This paper proposes an SLSR algorithm that uses convolutional principal component analysis (CPCA) and random matching. The technologies of CPCA and random matching greatly improve the efficiency of self-learning. There are two main steps in this algorithm: forming the training and testing the data sets and patch matching. In the data set forming step, we propose the CPCA to extract the low-dimensional features of the data set. The CPCA uses a convolutional method to quickly extract the principal component analysis (PCA) features of each image patch in every training and testing image. In the patch matching step, we propose a two-step random oscillation accompanied with propagation to accelerate the matching process. This patch matching method avoids exhaustive searching by utilizing the local similarity prior of natural images. The two-step random oscillation first performs a coarse patch matching using the variance feature and then performs a detailed matching using the PCA feature, which is useful to find reliable matching patches. The propagation strategy enables patches to propagate the good matching patches to their neighbors. The experimental results demonstrate that the proposed algorithm has a substantially lower time cost than that of many existing self-learning algorithms, leading to better reconstruction quality.
引用
收藏
页码:1108 / 1121
页数:14
相关论文
共 50 条
  • [21] Sectioning and super-resolution using unknown random patterns
    Hoffman, Zachary R.
    DiMarzio, Charles A.
    THREE-DIMENSIONAL AND MULTIDIMENSIONAL MICROSCOPY: IMAGE ACQUISITION AND PROCESSING XXIII, 2016, 9713
  • [22] Super-resolution based on self-example learning and guided filtering
    Chaudhry, Alina Majeed
    Riaz, M. Mohsin
    Ghafoor, Abdul
    SIGNAL IMAGE AND VIDEO PROCESSING, 2019, 13 (02) : 237 - 244
  • [23] Self-Supervised Learning for Rolling Shutter Temporal Super-Resolution
    Fan, Bin
    Guo, Ying
    Dai, Yuchao
    Xu, Chao
    Shi, Boxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 769 - 782
  • [24] CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks
    Chen, Honggang
    He, Xiaohai
    Ren, Chao
    Qing, Linbo
    Teng, Qizhi
    NEUROCOMPUTING, 2018, 285 : 204 - 219
  • [25] Acceleration of super-resolution for multispectral images using self-example learning and sparse representation
    Moustafa, Marwa S.
    Ebied, Hala M.
    Helmy, Ashraf K.
    Nazamy, Taymoor M.
    Tolba, Mohamed F.
    COMPUTERS & ELECTRICAL ENGINEERING, 2017, 62 : 249 - 265
  • [26] Super-Resolution Image Restoration Using Convolutional Neural Network
    Yu, Nedzelskyi O.
    Lashchevska, N. O.
    VISNYK NTUU KPI SERIIA-RADIOTEKHNIKA RADIOAPARATOBUDUVANNIA, 2023, (91): : 79 - 86
  • [27] Image Super-Resolution Using Dictionaries and Self-Similarity
    Bhosale, Gaurav G.
    Deshmukh, Ajinkya S.
    Medasani, Swarup S.
    Dhuli, Ravindra
    2014 INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS (SPCOM), 2014,
  • [28] Image super-resolution using a dilated convolutional neural network
    Lin, Guimin
    Wu, Qingxiang
    Qiu, Lida
    Huang, Xixian
    NEUROCOMPUTING, 2018, 275 : 1219 - 1230
  • [29] SUPER-RESOLUTION OF COMPRESSED VIDEOS USING CONVOLUTIONAL NEURAL NETWORKS
    Kappeler, Armin
    Yoo, Seunghwan
    Dai, Qiqin
    Katsaggelos, Aggelos K.
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1150 - 1154
  • [30] Super-Resolution PET Imaging Using Convolutional Neural Networks
    Song, Tzu-An
    Chowdhury, Samadrita Roy
    Yang, Fan
    Dutta, Joyita
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 518 - 528