Predicting multidimensional data via tensor learning

被引:3
|
作者
Brandi, Giuseppe [1 ]
Di Matteo, T. [1 ,2 ,3 ]
机构
[1] Kings Coll London, Dept Math, London WC2R 2LS, England
[2] Complex Sci Hub Vienna, Josefstaedter Str 39, A-1080 Vienna, Austria
[3] Ctr Ric Enrico Fermi, Via Panisperna 89 A, I-00184 Rome, Italy
关键词
Tensor regression; Multiway data; ALS; Multilinear regression; REGRESSION; DECOMPOSITIONS;
D O I
10.1016/j.jocs.2021.101372
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The analysis of multidimensional data is becoming a more and more relevant topic in statistical and machine learning research. Given their complexity, such data objects are usually reshaped into matrices or vectors and then analysed. However, this methodology presents several drawbacks. First of all, it destroys the intrinsic interconnections among datapoints in the multidimensional space and, secondly, the number of parameters to be estimated in a model increases exponentially. We develop a model that overcomes such drawbacks. In particular, in this paper, we propose a parsimonious tensor regression model that retains the intrinsic multidimensional structure of the dataset. Tucker structure is employed to achieve parsimony and a shrinkage penalization is introduced to deal with over-fitting and collinearity. To estimate the model parameters, an Alternating Least Squares algorithm is developed. In order to validate the model performance and robustness, a simulation exercise is produced. Moreover, we perform an empirical analysis that highlight the forecasting power of the model with respect to benchmark models. This is achieved by implementing an autoregressive specification on the Foursquares spatio-temporal dataset together with a macroeconomic panel dataset. Overall, the proposed model is able to outperform benchmark models present in the forecasting literature.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] TENSOR ENSEMBLE LEARNING FOR MULTIDIMENSIONAL DATA
    Kisil, Ilia
    Moniri, Ahmad
    Mandic, Danilo P.
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 1358 - 1362
  • [2] Tensor-Train networks for learning predictive modeling of multidimensional data
    da Costa, Nazareth
    Attux, Romis
    Cichocki, Andrzej
    Romano, Joao M. T.
    NEUROCOMPUTING, 2025, 637
  • [3] Learning from Low Rank Tensor Data: A Random Tensor Theory Perspective
    Seddik, Mohamed El Amine
    Tiomoko, Malik
    Decurninge, Alexis
    Panov, Maxim
    Guillaud, Maxime
    UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 1858 - 1867
  • [4] Understanding Generalization in Deep Learning via Tensor Methods
    Li, Jingling
    Sun, Yanchao
    Su, Jiahao
    Suzuki, Taiji
    Huang, Furong
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 108, 2020, 108 : 504 - 514
  • [5] A New Multilayer Network Construction via Tensor Learning
    Brandi, Giuseppe
    Di Matteo, Tiziana
    COMPUTATIONAL SCIENCE - ICCS 2020, PT VI, 2020, 12142 : 148 - 154
  • [6] Tensor MUSIC in Multidimensional Sparse Arrays
    Liu, Chun-Lin
    Vaidyanathan, P. P.
    2015 49TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, 2015, : 1783 - 1787
  • [7] Sustainable fertilisation management via tensor multi-task learning using multi-dimensional agricultural data
    Zhang, Yu
    Wang, Xulong
    Liu, Tong
    Wang, Ruijing
    Li, Yang
    Xue, Qing
    Yang, Po
    JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2023, 34
  • [8] SpTFS: Sparse Tensor Format Selection for MTTKRP via Deep Learning
    Sun, Qingxiao
    Liu, Yi
    Dun, Ming
    Yang, Hailong
    Luan, Zhongzhi
    Gan, Lin
    Yang, Guangwen
    Qian, Depei
    PROCEEDINGS OF SC20: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC20), 2020,
  • [9] Tensor Multi-Task Learning for Predicting Alzheimer's Disease Progression using MRI data with Spatio-temporal Similarity Measurement
    Zhang, Yu
    Yang, Po
    Lanfranchi, Vitaveska
    2021 IEEE 19TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2021,
  • [10] Estimation of Gaussian mixture models via tensor moments with application to online learning
    Rahmani, Donya
    Niranjan, Mahesan
    Fay, Damien
    Takeda, Akiko
    Brodzki, Jacek
    PATTERN RECOGNITION LETTERS, 2020, 131 : 285 - 292