Deep Efficient Continuous Manifold Learning for Time Series Modeling

被引:4
作者
Jeong, Seungwoo [1 ]
Ko, Wonjun [2 ]
Mulyadi, Ahmad Wisnu [2 ]
Suk, Heung-Il [1 ]
机构
[1] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea
[2] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
关键词
Cholesky space; deep learning; manifold learning; manifold ordinary differential equation; multivariate time series modeling; symmetric positive definite matrix; NEURAL-NETWORK;
D O I
10.1109/TPAMI.2023.3320125
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modeling non-euclidean data is drawing extensive attention along with the unprecedented successes of deep neural networks in diverse fields. Particularly, a symmetric positive definite matrix is being actively studied in computer vision, signal processing, and medical image analysis, due to its ability to learn beneficial statistical representations. However, owing to its rigid constraints, it remains challenging to optimization problems and inefficient computational costs, especially, when incorporating it with a deep learning framework. In this paper, we propose a framework to exploit a diffeomorphism mapping between Riemannian manifolds and a Cholesky space, by which it becomes feasible not only to efficiently solve optimization problems but also to greatly reduce computation costs. Further, for dynamic modeling of time-series data, we devise a continuous manifold learning method by systematically integrating a manifold ordinary differential equation and a gated recurrent neural network. It is worth noting that due to the nice parameterization of matrices in a Cholesky space, training our proposed network equipped with Riemannian geometric metrics is straightforward. We demonstrate through experiments over regular and irregular time-series datasets that our proposed model can be efficiently and reliably trained and outperforms existing manifold methods and state-of-the-art methods in various time-series tasks.
引用
收藏
页码:171 / 184
页数:14
相关论文
共 33 条
  • [31] Zhang XC, 2020, AAAI CONF ARTIF INTE, V34, P6845
  • [32] FairMOT: On the Fairness of Detection and Re-identification in Multiple Object Tracking
    Zhang, Yifu
    Wang, Chunyu
    Wang, Xinggang
    Zeng, Wenjun
    Liu, Wenyu
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (11) : 3069 - 3087
  • [33] Zhen XJ, 2019, IEEE I CONF COMP VIS, P10620, DOI [10.1109/ICCV.2019.01072, 10.1109/iccv.2019.01072]