Reshaped tensor nuclear norms for higher order tensor completion

被引:0
作者
Kishan Wimalawarne
Hiroshi Mamitsuka
机构
[1] The University of Tokyo,Department of Mathematical Informatics
[2] Kyoto University,Bioinformatics Center, Institute for Chemical Research
[3] Aalto University,Department of Computer Science
来源
Machine Learning | 2021年 / 110卷
关键词
Tensor nuclear norm; Reshaping; CP rank; Generalization bounds;
D O I
暂无
中图分类号
学科分类号
摘要
We investigate optimal conditions for inducing low-rankness of higher order tensors by using convex tensor norms with reshaped tensors. We propose the reshaped tensor nuclear norm as a generalized approach to reshape tensors to be regularized by using the tensor nuclear norm. Furthermore, we propose the reshaped latent tensor nuclear norm to combine multiple reshaped tensors using the tensor nuclear norm. We analyze the generalization bounds for tensor completion models regularized by the proposed norms and show that the novel reshaping norms lead to lower Rademacher complexities. Through simulation and real-data experiments, we show that our proposed methods are favorably compared to existing tensor norms consolidating our theoretical claims.
引用
收藏
页码:507 / 531
页数:24
相关论文
共 19 条
  • [1] Berclaz J(2011)Multiple object tracking using K-shortest paths optimization IEEE Transactions on Pattern Analysis and Machine Intelligence 33 1806-19
  • [2] Fleuret F(1970)Analysis of individual differences in multidimensional scaling via an n-way generalization of “eckart-young”decomposition Psychometrika 35 283-319
  • [3] Turetken E(2007)Transductive rademacher complexity and its applications Learning Theory 4539 157-171
  • [4] Fua P(1970)Foundations of the PARAFAC procedure: Models and conditions for an explanatory multimodal factor analysis UCLA Working Papers in Phonetics 16 1-84
  • [5] Carroll JD(1927)The expression of a tensor or a polyadic as a sum of products Journal of Mathematics and Physics 6 164-189
  • [6] Chang J-J(2009)Tensor decompositions and applications SIAM Review 51 455-500
  • [7] El-Yaniv R(2005)Some estimates of norms of random matrices Proceedings of the American Mathematical Society 133 1273-1282
  • [8] Pechyony D(2014)Blind multilinear identification IEEE Transactions on Information Theory 60 1260-1280
  • [9] Harshman RA(2014)Matrix completion with the trace norm: Learning, bounding, and transducing Journal of Machine Learning Research 15 3401-3423
  • [10] Hitchcock FL(2016)On tensor completion via nuclear norm minimization Foundations of Computational Mathematics 16 1031-1068