Full-Mode-Augmentation Tensor-Train Rank Minimization for Hyperspectral Image Inpainting

被引:1
|
作者
Zhang, Tian-Heng [1 ]
Zhao, Jian-Li [1 ]
Fang, Sheng [1 ]
Li, Zhe [1 ]
Gong, Mao-Guo [1 ,2 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao 266590, Peoples R China
[2] Xidian Univ, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
关键词
Full-mode-augmentation; hyperspectral image (HSI) inpainting; low-rank tensor completion; tensor augmentation (TA); tensor-train; MATRIX FACTORIZATION; COMPLETION; CLASSIFICATION; REGULARIZATION; NETWORK;
D O I
10.1109/TGRS.2023.3341030
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Hyperspectral image (HSI) inpainting is a fundamental task in remote sensing image processing, which is helpful for subsequent applications such as classification and unmixing. Recently, tensor-train decomposition (TTD)-based low-rank methods have achieved great success in image inpainting because of the balanced tensor unfolding and the use of tensor augmentation (TA). However, the TTD algorithm only performs TA on the third mode, and cannot effectively mine the spectral domain information of HSIs. Aiming at this problem, this article extends TA to each mode of the tensor and proposes a full-mode-augmentation TT decomposition (FTTD). More precisely, the HSI is cast along each mode to get a 3-D N th-order tensor sequence, and all the tensors in the sequence are performed TTD to get $3N$ factor tensors that model the correlation on various modes. Then, the full-mode-augmentation tensor unfolding method is given by performing TT unfolding on each $N$ th-order tensor. We implement FTTD by minimizing the rank of the unfolding matrix and thus provide the tensor completion framework based on full-mode-augmentation tensor-train rank minimization. Finally, using the framework, we optimize the current two classical iterative algorithms nuclear norm minimization and parallel matrix decomposition. These two algorithms utilize the unfolding matrices in the framework to effectively mine spatial and spectral information, thereby making the restored tensor more approximate to the original HSI. Experiments on various HSIs have shown that the proposed method outperforms compared methods in terms of visual and quantitative measures.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [21] Convolutional Neural Network Compression via Tensor-Train Decomposition on Permuted Weight Tensor with Automatic Rank Determination
    Gabor, Mateusz
    Zdunek, Rafal
    COMPUTATIONAL SCIENCE - ICCS 2022, PT III, 2022, 13352 : 654 - 667
  • [22] Relaxed Low Tensor Train Rank Representation with Structural Smoothness for Hyperspectral Image Super-resolution
    Li, Shengchuan
    Jia, Huidi
    Chen, Xi'ai
    Li, Sun
    Han, Zhi
    Tang, Yandong
    Liu, Jiaxin
    2020 10TH INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER 2020), 2020, : 384 - 389
  • [23] Tensor Completion Using Kronecker Rank-1 Tensor Train With Application to Visual Data Inpainting
    Sun, Weize
    Chen, Yuan
    So, Hing Cheung
    IEEE ACCESS, 2018, 6 : 47804 - 47814
  • [24] A Full Tensor Network for Hyperspectral Image Classification
    Zhang, Wei-Tao
    Li, Yi-Bang
    Zheng, Sheng-Di
    Liu, Lu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [25] Image inpainting by low-rank tensor decomposition and multidirectional search
    Liu, Xuya
    Hao, Caiyan
    Su, Zezhao
    Qi, Zerong
    Fu, Shujun
    Li, Yuliang
    Han, Hongbin
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (05)
  • [26] Reweighted l2 norm Minimization Approach to Image Inpainting Based on Rank Minimization
    Takahashi, Tomohiro
    Konishi, Katsumi
    Furukawa, Toshihiro
    2011 IEEE 54TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2011,
  • [27] Quaternion tensor train rank minimization with sparse regularization in a transformed domain for quaternion tensor completion
    Miao, Jifei
    Kou, Kit Ian
    Yang, Liqiao
    Cheng, Dong
    KNOWLEDGE-BASED SYSTEMS, 2024, 284
  • [28] Tensor Cascaded-Rank Minimization in Subspace: A Unified Regime for Hyperspectral Image Low-Level Vision
    Sun, Le
    He, Chengxun
    Zheng, Yuhui
    Wu, Zebin
    Jeon, Byeungwoo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 100 - 115
  • [29] Subspace clustering and multiple matrix rank minimization approach to image inpainting algorithm
    Takahashi, Tomohiro
    Konishi, Katsumi
    Uruma, Kazunori
    Furukawa, Toshihiro
    2017 56TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2017, : 1052 - 1055
  • [30] Subspace Methods with Local Refinements for Eigenvalue Computation Using Low-Rank Tensor-Train Format
    Zhang, Junyu
    Wen, Zaiwen
    Zhang, Yin
    JOURNAL OF SCIENTIFIC COMPUTING, 2017, 70 (02) : 478 - 499