Multivariate time-series classification with hierarchical variational graph pooling

被引:50
作者
Duan, Ziheng [1 ,2 ]
Xu, Haoyan [1 ,2 ,3 ]
Wang, Yueyang [1 ]
Huang, Yida [1 ]
Ren, Anni [2 ]
Xu, Zhongbin [2 ]
Sun, Yizhou [3 ]
Wang, Wei [3 ]
机构
[1] Chongqing Univ, Sch Big Data & Software Engn, Chongqing 401331, Peoples R China
[2] Zhejiang Univ, Coll Energy Engn, Hangzhou 310027, Zhejiang, Peoples R China
[3] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Multivariate time series classification; Graph neural networks; Graph pooling; Graph classification;
D O I
10.1016/j.neunet.2022.07.032
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, multivariate time-series classification (MTSC) has attracted considerable attention owing to the advancement of sensing technology. Existing deep-learning-based MTSC techniques, which mostly rely on convolutional or recurrent neural networks, focus primarily on the temporal dependency of a single time series. Based on this, complex pairwise dependencies among multivariate variables can be better described using advanced graph methods, where each variable is regarded as a node in the graph, and their dependencies are regarded as edges. Furthermore, current spatial- temporal modeling (e.g., graph classification) methodologies based on graph neural networks (GNNs) are inherently flat and cannot hierarchically aggregate node information. To address these limitations, we propose a novel graph-pooling-based framework, MTPool, to obtain an expressive global representation of MTS. We first convert MTS slices into graphs using the interactions of variables via a graph structure learning module and obtain the spatial-temporal graph node features via a temporal convolutional module. To obtain global graph-level representation, we design an "encoder-decoder "-based variational graph pooling module to create adaptive centroids for cluster assignments. Then, we com-bine GNNs and our proposed variational graph pooling layers for joint graph representation learning and graph coarsening, after which the graph is progressively coarsened to one node. Finally, a differentiable classifier uses this coarsened representation to obtain the final predicted class. Experiments on ten benchmark datasets showed that MTPool outperforms state-of-the-art strategies in the MTSC task. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页码:481 / 490
页数:10
相关论文
共 46 条
[1]  
Bagnall A. J., 2020, TALE 2 TOOLKITS REPO
[2]  
Bagnall A, 2018, Arxiv, DOI [arXiv:1811.00075, DOI 10.48550/ARXIV.1811.00075, 10.48550/ARXIV.1811.00075]
[3]   SimGNN: A Neural Network Approach to Fast Graph Similarity Computation [J].
Bai, Yunsheng ;
Ding, Hao ;
Bian, Song ;
Chen, Ting ;
Sun, Yizhou ;
Wang, Wei .
PROCEEDINGS OF THE TWELFTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'19), 2019, :384-392
[4]   Distributed FastShapelet Transform: a Big Data time series classification algorithm [J].
Baldan, Francisco J. ;
Benitez, Jose M. .
INFORMATION SCIENCES, 2019, 496 :451-463
[5]  
Chen J, 2018, Arxiv, DOI arXiv:1801.10247
[6]  
Defferrard M, 2016, ADV NEUR IN, V29
[7]  
Duan ZH, 2021, Arxiv, DOI arXiv:2103.05749
[8]   Hybrid artificial neural network and cooperation search algorithm for nonlinear river flow time series forecasting in humid and semi-humid regions [J].
Feng, Zhong-kai ;
Niu, Wen-jing .
KNOWLEDGE-BASED SYSTEMS, 2021, 211
[9]  
Gao HY, 2019, Arxiv, DOI arXiv:1905.05178
[10]   DTW-NN: A novel neural network for time series recognition using dynamic alignment between inputs and weights [J].
Iwana, Brian Kenji ;
Frinken, Volkmar ;
Uchida, Seiichi .
KNOWLEDGE-BASED SYSTEMS, 2020, 188