Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [31] Image Inpainting Based on Structural Tensor Edge Intensity Model
    Jing Wang
    Yan-Hong Zhou
    Hai-Feng Sima
    Zhan-Qiang Huo
    Ai-Zhong Mi
    International Journal of Automation and Computing, 2021, 18 (02) : 256 - 265
  • [32] Traffic matrix completion by weighted tensor nuclear norm minimization and time slicing
    Miyata, Takamichi
    IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2024, 15 (02): : 311 - 323
  • [33] Sparse and Truncated Nuclear Norm Based Tensor Completion
    Han, Zi-Fa
    Leung, Chi-Sing
    Huang, Long-Ting
    So, Hing Cheung
    NEURAL PROCESSING LETTERS, 2017, 45 (03) : 729 - 743
  • [34] Sparse and Truncated Nuclear Norm Based Tensor Completion
    Zi-Fa Han
    Chi-Sing Leung
    Long-Ting Huang
    Hing Cheung So
    Neural Processing Letters, 2017, 45 : 729 - 743
  • [35] RESEARCH ON WEIGHTED PRIORITY OF EXEMPLAR-BASED IMAGE INPAINTING
    Zhou Yatong Li Lin Xia Kewen (School of Information Engineering
    Journal of Electronics(China), 2012, (Z1) : 166 - 170
  • [36] On Tensor Completion via Nuclear Norm Minimization
    Ming Yuan
    Cun-Hui Zhang
    Foundations of Computational Mathematics, 2016, 16 : 1031 - 1068
  • [37] On Tensor Completion via Nuclear Norm Minimization
    Yuan, Ming
    Zhang, Cun-Hui
    FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2016, 16 (04) : 1031 - 1068
  • [38] A majorization-minimization weighted soft thresholding algorithm for weighted nuclear norm minimization
    Geng, Juan
    Wang, Laisheng
    Fu, Aimin
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2015, 6 (01) : 59 - 68
  • [39] NONLOCAL WEIGHTED NUCLEAR NORM MINIMIZATION BASED SPARSE-SAMPLING CT IMAGE RECONSTRUCTION
    Yang, Kang
    Xia, Wenjun
    Bao, Peng
    Zhou, Jiliu
    Zhang, Yi
    2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019), 2019, : 1700 - 1703
  • [40] A Tensor-based Technique for Structure-aware Image Inpainting
    Akl, Adib
    Yaacoub, Charles
    ICPRAM: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2017, : 599 - 605