Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [1] Image inpainting algorithm based on tensor decomposition and weighted nuclear norm
    Xuya Liu
    Caiyan Hao
    Zezhao Su
    Zerong Qi
    Shujun Fu
    Yuliang Li
    Hongbin Han
    Multimedia Tools and Applications, 2023, 82 : 3433 - 3458
  • [2] Image inpainting by low-rank tensor decomposition and multidirectional search
    Liu, Xuya
    Hao, Caiyan
    Su, Zezhao
    Qi, Zerong
    Fu, Shujun
    Li, Yuliang
    Han, Hongbin
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (05)
  • [3] A Non-Local Tensor Completion Algorithm Based on Weighted Tensor Nuclear Norm
    Wang, Wenzhe
    Zheng, Jingjing
    Zhao, Li
    Chen, Huiling
    Zhang, Xiaoqin
    ELECTRONICS, 2022, 11 (19)
  • [4] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024,
  • [5] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, : 7621 - 7634
  • [6] A new structure tensor based image inpainting algorithm
    Liu, Ying
    Liu, Chanjuan
    Zou, Hailin
    INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2016, 7 (04) : 294 - 303
  • [7] A tensor completion method based on tensor QR decomposition with truncated nuclear norm and sparse regularization
    Han, Xinao
    Cheng, Guanghui
    JAPAN JOURNAL OF INDUSTRIAL AND APPLIED MATHEMATICS, 2025, 42 (01) : 223 - 243
  • [8] A Fast Tensor Completion Method Based on Tensor QR Decomposition and Tensor Nuclear Norm Minimization
    Wu, Fengsheng
    Li, Yaotang
    Li, Chaoqian
    Wu, Ying
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 1267 - 1277
  • [9] Adaptive weighting function for weighted nuclear norm based matrix/tensor completion
    Zhao, Qian
    Lin, Yuji
    Wang, Fengxingyu
    Meng, Deyu
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (02) : 697 - 718
  • [10] Weighted tensor nuclear norm minimization for tensor completion using tensor-SVD
    Mu, Yang
    Wang, Ping
    Lu, Liangfu
    Zhang, Xuyun
    Qi, Lianyong
    PATTERN RECOGNITION LETTERS, 2020, 130 (130) : 4 - 11