Predicting multidimensional data via tensor learning

被引:3
|
作者
Brandi, Giuseppe [1 ]
Di Matteo, T. [1 ,2 ,3 ]
机构
[1] Kings Coll London, Dept Math, London WC2R 2LS, England
[2] Complex Sci Hub Vienna, Josefstaedter Str 39, A-1080 Vienna, Austria
[3] Ctr Ric Enrico Fermi, Via Panisperna 89 A, I-00184 Rome, Italy
关键词
Tensor regression; Multiway data; ALS; Multilinear regression; REGRESSION; DECOMPOSITIONS;
D O I
10.1016/j.jocs.2021.101372
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The analysis of multidimensional data is becoming a more and more relevant topic in statistical and machine learning research. Given their complexity, such data objects are usually reshaped into matrices or vectors and then analysed. However, this methodology presents several drawbacks. First of all, it destroys the intrinsic interconnections among datapoints in the multidimensional space and, secondly, the number of parameters to be estimated in a model increases exponentially. We develop a model that overcomes such drawbacks. In particular, in this paper, we propose a parsimonious tensor regression model that retains the intrinsic multidimensional structure of the dataset. Tucker structure is employed to achieve parsimony and a shrinkage penalization is introduced to deal with over-fitting and collinearity. To estimate the model parameters, an Alternating Least Squares algorithm is developed. In order to validate the model performance and robustness, a simulation exercise is produced. Moreover, we perform an empirical analysis that highlight the forecasting power of the model with respect to benchmark models. This is achieved by implementing an autoregressive specification on the Foursquares spatio-temporal dataset together with a macroeconomic panel dataset. Overall, the proposed model is able to outperform benchmark models present in the forecasting literature.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Optimal Data Reduction of Training Data in Machine Learning-Based Modelling: A Multidimensional Bin Packing Approach
    Wibbeke, Jelke
    Teimourzadeh Baboli, Payam
    Rohjans, Sebastian
    ENERGIES, 2022, 15 (09)
  • [22] Learning from Binary Multiway Data: Probabilistic Tensor Decomposition and its Statistical Optimality
    Wang, Miaoyan
    Li, Lexin
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [23] Predicting Longitudinal Outcomes of Alzheimer's Disease via a Tensor-Based Joint Classification and Regression Model
    Brand, Lodewijk
    Nichols, Kai
    Wang, Hua
    Huang, Heng
    Shen, Li
    PACIFIC SYMPOSIUM ON BIOCOMPUTING 2020, 2020, : 7 - 18
  • [24] Tensor learning of pointwise mutual information from EHR data for early prediction of sepsis
    Nesaragi, Naimahmed
    Patidar, Shivnarayan
    Aggarwal, Vaneet
    COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 134
  • [25] Learning Tensor Representations for Meta-Learning
    Deng, Samuel
    Guo, Yilin
    Hsu, Daniel
    Mandal, Debmalya
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [26] Identifying disease sensitive and quantitative trait-relevant biomarkers from multidimensional heterogeneous imaging genetics data via sparse multimodal multitask learning
    Wang, Hua
    Nie, Feiping
    Huang, Heng
    Risacher, Shannon L.
    Saykin, Andrew J.
    Shen, Li
    BIOINFORMATICS, 2012, 28 (12) : I127 - I136
  • [27] Incremental Bayesian matrix/tensor learning for structural monitoring data imputation and response forecasting
    Ren, Pu
    Chen, Xinyu
    Sun, Lijun
    Sun, Hao
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 158
  • [28] Supervised Learning with Tensor Networks
    Stoudenmire, E. M.
    Schwab, David J.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [29] KERNEL LEARNING WITH TENSOR NETWORKS
    Konstantinidis, Kriton
    Li, Shengxi
    Mandic, Danilo P.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2920 - 2924
  • [30] Tensor Dropout for Robust Learning
    Kolbeinsson, Arinbjorn
    Kossaifi, Jean
    Panagakis, Yannis
    Bulat, Adrian
    Anandkumar, Animashree
    Tzoulaki, Ioanna
    Matthews, Paul M.
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (03) : 630 - 640