Image inpainting algorithm based on tensor decomposition and weighted nuclear norm

被引:4
|
作者
Liu, Xuya [1 ]
Hao, Caiyan [2 ]
Su, Zezhao [3 ]
Qi, Zerong [4 ]
Fu, Shujun [5 ]
Li, Yuliang [6 ]
Han, Hongbin [7 ,8 ]
机构
[1] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[2] Qingdao Hiimage Technol Co Ltd, Qingdao 266000, Peoples R China
[3] Guangdong Technion Israel Inst Technol, Shantou 515063, Peoples R China
[4] Shandong Chengshi Elect Technol Ltd Co, Jinan 250031, Peoples R China
[5] Shandong Univ, Sch Math, Jinan 250100, Peoples R China
[6] Shandong Univ, Dept Intervent Med, Hosp 2, Jinan 250100, Peoples R China
[7] Peking Univ Third Hosp, Dept Radiol, Beijing 100089, Peoples R China
[8] Beijing Key Lab Magnet Resonance Imaging Equipmen, Beijing 100089, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Low-rank approximation; Nonlocal similarity; Tensor completion; Tensor ring decomposition; MATRIX COMPLETION;
D O I
10.1007/s11042-022-12635-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For a damaged image, recovering an image with missing entire rows or columns is a challenging problem arising in many real applications, such as digital image inpainting. For this kind of information missing situation, the diffusion-based inpainting methods are tend to produce blur, the exemplar-based methods are prone to error filling and the neural network-based methods are highly dependent on data. Many existing approaches formulate this problem as a general low-rank matrix approximate one which cannot handle this special structural missing very well. In this paper, we propose a novel image inpainting algorithm named nonlocal low-rank tensor completion (NLLRTC) based on the nonlocal self-similarity prior and the low-rank prior. By using the nonlocal self-similarity of image patches, we directly stack these patches into a three-dimensional similar tensor instead of pulling them into column vectors, then the similar tensor can be completed by tensor ring (TR) decomposition. By leveraging the alternating direction method under the augmented Lagrangian multiplier framework, the optimization results can be obtained. Moreover, a weighted nuclear norm is added to the tensor completion model to achieve better inpainting performance, which we call weighted nonlocal low-rank tensor completion (WNLLRTC) algorithm. Our empirical studies show encouraging results on both quantitative assessment and visual interpretation of our proposed methods in comparison to some state-of-the-art algorithms.
引用
收藏
页码:3433 / 3458
页数:26
相关论文
共 50 条
  • [41] INVERSE HALFTONING BASED ON WEIGHTED NUCLEAR NORM MINIMIZATION
    Yang, Jun
    Jia, Xiaojun
    Liu, Zihao
    Chen, Li
    Wu, Ying
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2023, 23 (04)
  • [42] A New Approach of Image Inpainting Based on PSO Algorithm
    Chung, Shu-Chiang
    Kuan, Ta-Wen
    Lu, Chuan-Pin
    Lin, Hsin-Yi
    1ST INTERNATIONAL CONFERENCE ON ORANGE TECHNOLOGIES (ICOT 2013), 2013, : 205 - 209
  • [43] Research on Mural Inpainting Method based on MCA Image Decomposition
    Qiang, Zhenping
    He, Libo
    Chen, Yaqiong
    Xu, Dan
    IIP'17: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION PROCESSING, 2017,
  • [44] Image Inpainting Algorithm Based on Adaptive Template Direction
    Wu, Xuewen
    Liu, Na
    Song, Yunyun
    2013 6TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), VOLS 1-3, 2013, : 374 - 378
  • [45] Image Inpainting Algorithm Based on KSVD and Improved CDD
    Liu, Zexin
    Wan, Wanggen
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 413 - 417
  • [46] A Fast Image Inpainting Algorithm Based on TV Model
    Lu, Xiaobao
    Wang, Weilan
    Zhuoma, Duojie
    INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS (IMECS 2010), VOLS I-III, 2010, : 1457 - +
  • [47] An Improved Exemplar-based Image Inpainting Algorithm
    Xiang, Chunyang
    Duan, Pengsong
    Cao, Yangjie
    Shi, Lei
    2014 PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE 2014), 2014, : 770 - 775
  • [48] A New Image Inpainting Approach based on Criminisi Algorithm
    Ouattara, Nouho
    Loum, Georges Laussane
    Pandry, Ghislain Koffi
    Atiampo, Armand Kodjo
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (06) : 423 - 433
  • [49] Research on Algorithm for Fast Image Inpainting Based on Exemplars
    Zhu, Shengfeng
    PROCEEDINGS OF THE 2018 3RD INTERNATIONAL WORKSHOP ON MATERIALS ENGINEERING AND COMPUTER SCIENCES (IWMECS 2018), 2018, 78 : 226 - 230
  • [50] Enhanced algorithm for Exemplar-based Image Inpainting
    Liu, Ye-fei
    Wang, Fu-long
    Xi, Xiang-yan
    2013 9TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2013, : 209 - 213