Optimization on the Hierarchical Tucker manifold - Applications to tensor completion

被引:56
|
作者
Da Silva, Curt [1 ]
Herrmann, Felix J. [2 ]
机构
[1] Univ British Columbia, Dept Math, Vancouver, BC V5Z 1M9, Canada
[2] Univ British Columbia, Dept Earth & Ocean Sci, Vancouver, BC V5Z 1M9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Hierarchical Tucker tensors; Tensor completion; Riemannian manifold optimization; Gauss-Newton; Differential geometry; Low-rank tensor; SINGULAR-VALUE DECOMPOSITION; APPROXIMATION; CONVERGENCE; ALGORITHM; RANK;
D O I
10.1016/j.laa.2015.04.015
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this work, we develop an optimization framework for problems whose solutions are well-approximated by Hierarchical Tucker (HT) tensors, an efficient structured tensor format based on recursive subspace factorizations. By exploiting the smooth manifold structure of these tensors, we construct standard optimization algorithms such as Steepest Descent and Conjugate Gradient for completing tensors from missing entries. Our algorithmic framework is fast and scalable to large problem sizes as we do not require SVDs on the ambient tensor space, as required by other methods. Moreover, we exploit the structure of the Gramian matrices associated with the HT format to regularize our problem, reducing overfitting for high subsampling ratios. We also find that the organization of the tensor can have a major impact on completion from realistic seismic acquisition geometries. These samplings are far from idealized randomized samplings that are usually considered in the literature but are realizable in practical scenarios. Using these algorithms, we successfully interpolate large-scale seismic data sets and demonstrate the competitive computational scaling of our algorithms as the problem sizes grow. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:131 / 173
页数:43
相关论文
共 50 条
  • [1] Tensor Manifold with Tucker Rank Constraints
    Chang, Shih Yu
    Luo, Ziyan
    Qi, Liqun
    ASIA-PACIFIC JOURNAL OF OPERATIONAL RESEARCH, 2022, 39 (02)
  • [2] RECOVERING LOW CP/TUCKER RANKED TENSORS, WITH APPLICATIONS IN TENSOR COMPLETION
    Gao, Xiang
    Jiang, Bo
    Tao, Shaozhe
    PACIFIC JOURNAL OF OPTIMIZATION, 2015, 11 (02): : 385 - 402
  • [3] Bayesian Tensor Tucker Completion With a Flexible Core
    Tong, Xueke
    Cheng, Lei
    Wu, Yik-Chung
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 4077 - 4091
  • [4] TuckER: Tensor Factorization for Knowledge Graph Completion
    Balazevic, Ivana
    Allen, Carl
    Hospedales, Timothy M.
    2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 5185 - 5194
  • [5] Tensor Completion in Hierarchical Tensor Representations
    Rauhut, Holger
    Schneider, Reinhold
    Stojanac, Zeljka
    COMPRESSED SENSING AND ITS APPLICATIONS, 2015, : 419 - 450
  • [6] Parallel tensor sampling in the hierarchical Tucker format
    Grasedyck, Lars
    Kriemann, Ronald
    Loebbert, Christian
    Naegel, Arne
    Wittum, Gabriel
    Xylouris, Konstantinos
    COMPUTING AND VISUALIZATION IN SCIENCE, 2015, 17 (02) : 67 - 78
  • [7] Implicit Regularization and Entrywise Convergence of Riemannian Optimization for Low Tucker-Rank Tensor Completion
    Wang, Haifeng
    Chen, Jinchi
    Wei, Ke
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [8] Rank-Adaptive Tensor Completion Based on Tucker Decomposition
    Liu, Siqi
    Shi, Xiaoyu
    Liao, Qifeng
    ENTROPY, 2023, 25 (02)
  • [9] Fast Tucker Factorization for Large-Scale Tensor Completion
    Lee, Dongha
    Lee, Jaehyung
    Yu, Hwanjo
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 1098 - 1103
  • [10] Tensor Completion with Side Information: A Riemannian Manifold Approach
    Zhou, Tengfei
    Qian, Hui
    Shen, Zebang
    Zhang, Chao
    Xu, Congfu
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3539 - 3545