Self-Learning Super-Resolution Using Convolutional Principal Component Analysis and Random Matching

被引:10
|
作者
Xu, Jian [1 ]
Li, Meng [1 ]
Fan, Jiulun [1 ]
Zhao, Xiaoqiang [1 ]
Chang, Zhiguo [2 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Commun & Informat Engn, Xian 710121, Shaanxi, Peoples R China
[2] Changan Univ, Sch Informat Engn, Xian 710064, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; random oscillation; neighbor embedding; self-learning; principal component analysis; SINGLE-IMAGE SUPERRESOLUTION; SPARSE REPRESENTATION; INTERPOLATION; PROJECTION;
D O I
10.1109/TMM.2018.2871948
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Self-learning super-resolution (SLSR) algorithms have the advantage of being independent of an external training database. This paper proposes an SLSR algorithm that uses convolutional principal component analysis (CPCA) and random matching. The technologies of CPCA and random matching greatly improve the efficiency of self-learning. There are two main steps in this algorithm: forming the training and testing the data sets and patch matching. In the data set forming step, we propose the CPCA to extract the low-dimensional features of the data set. The CPCA uses a convolutional method to quickly extract the principal component analysis (PCA) features of each image patch in every training and testing image. In the patch matching step, we propose a two-step random oscillation accompanied with propagation to accelerate the matching process. This patch matching method avoids exhaustive searching by utilizing the local similarity prior of natural images. The two-step random oscillation first performs a coarse patch matching using the variance feature and then performs a detailed matching using the PCA feature, which is useful to find reliable matching patches. The propagation strategy enables patches to propagate the good matching patches to their neighbors. The experimental results demonstrate that the proposed algorithm has a substantially lower time cost than that of many existing self-learning algorithms, leading to better reconstruction quality.
引用
收藏
页码:1108 / 1121
页数:14
相关论文
共 50 条
  • [1] Two-direction self-learning super-resolution propagation based on neighbor embedding
    Xu, Jian
    Gao, Yan
    Xing, Jun
    Fan, Jiulun
    Gao, Qiannan
    Tang, Shaojie
    SIGNAL PROCESSING, 2021, 183
  • [2] A Self-Learning Approach to Single Image Super-Resolution
    Yang, Min-Chun
    Wang, Yu-Chiang Frank
    IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (03) : 498 - 508
  • [3] Combining self-learning based super-resolution with denoising for noisy images
    Lee, Oh-Young
    Lee, Jae-Won
    Kim, Jong-Ok
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 66 - 76
  • [4] Image Super-Resolution via Local Self-Learning Manifold Approximation
    1600, Institute of Electrical and Electronics Engineers Inc., United States (21): : 1245 - 1249
  • [5] Color Guided Depth Map Super-Resolution based on a Deep Self-Learning Approach
    Takeda, Kyohei
    Iwamoto, Yutaro
    Chen, Yen-Wei
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2020, : 588 - 591
  • [6] Audio Super-Resolution Using Analysis Dictionary Learning
    Dong, Jing
    Wang, Wenwu
    Chambers, Jonathon
    2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, : 604 - 608
  • [7] Investigation of multi-frame image super-resolution based on adaptive self-learning methods
    Mu, Shao-Shuo
    Zhang, Ye
    Jia, Ping
    JOURNAL OF MODERN OPTICS, 2017, 64 (02) : 111 - 121
  • [8] SLIM: A transparent structurized self-learning interpolation method for super-resolution images
    Xiao-Diao Chen
    Rui He
    Xiaoyang Mao
    The Visual Computer, 2024, 40 : 2857 - 2872
  • [9] SLIM: A transparent structurized self-learning interpolation method for super-resolution images
    Chen, Xiao-Diao
    He, Rui
    Mao, Xiaoyang
    VISUAL COMPUTER, 2024, 40 (04) : 2857 - 2872
  • [10] Single image super-resolution by combining self-learning and example-based learning methods
    Na Ai
    Jinye Peng
    Xuan Zhu
    Xiaoyi Feng
    Multimedia Tools and Applications, 2016, 75 : 6647 - 6662