Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [21] An Improved Image Inpainting Algorithm based on Image Segmentation
    Ying, Huang
    Kai, Li
    Ming, Yang
    ADVANCES IN INFORMATION AND COMMUNICATION TECHNOLOGY, 2017, 107 : 796 - 801
  • [22] A Tensor Regularized Nuclear Norm Method for Image and Video Completion
    A. H. Bentbib
    A. El Hachimi
    K. Jbilou
    A. Ratnani
    Journal of Optimization Theory and Applications, 2022, 192 : 401 - 425
  • [23] A Tensor Regularized Nuclear Norm Method for Image and Video Completion
    Bentbib, A. H.
    El Hachimi, A.
    Jbilou, K.
    Ratnani, A.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2022, 192 (02) : 401 - 425
  • [24] An Iterative Method for Tensor Inpainting Based on Higher-Order Singular Value Decomposition
    Yeganli, S. F.
    Yu, R.
    Demirel, H.
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2018, 37 (09) : 3827 - 3841
  • [25] HOSVD-Based Algorithm for Weighted Tensor Completion
    Chao, Zehan
    Huang, Longxiu
    Needell, Deanna
    JOURNAL OF IMAGING, 2021, 7 (07)
  • [26] AN IMAGE INPAINTING ALGORITHM BASED ON ENERGY MINIMIZATION
    Zhi, Zhanjiang
    Sun, Yi
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2012, 12 (03)
  • [27] Image Inpainting Based on Structural Tensor Edge Intensity Model
    Jing Wang
    Yan-Hong Zhou
    Hai-Feng Sima
    Zhan-Qiang Huo
    Ai-Zhong Mi
    International Journal of Automation and Computing, 2021, 18 : 256 - 265
  • [28] ISAR Image Inpainting Algorithm Based on DCGAN
    Wang, Tingfei
    Gao, Jingpeng
    Jiang, Zhiye
    2021 INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION (ISAP), 2021,
  • [29] Image Inpainting Algorithm Based on Successive Elimination
    Zhang, Ranran
    Ding, Youdong
    Wei, Shuhan
    PROCEEDINGS OF THE 8TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE, 2009, : 1111 - +
  • [30] Image Inpainting Based on Structural Tensor Edge Intensity Model
    Wang, Jing
    Zhou, Yan-Hong
    Sima, Hai-Feng
    Huo, Zhan-Qiang
    Mi, Ai-Zhong
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2021, 18 (02) : 256 - 265