Time Series Classification Method with Local Attention Enhancement

被引:0
作者
Li, Kewen [1 ]
Ke, Cuihong [1 ]
Zhang, Min [1 ]
Wang, Xiaohui [1 ]
Geng, Wenliang [1 ]
机构
[1] School of Computer Science and Technology, China University of Petroleum (East China), Shandong, Qingdao
关键词
multi-scale convolution; position perception; self-attention mechanism; time series classification;
D O I
10.3778/j.issn.1002-8331.2207-0444
中图分类号
学科分类号
摘要
Existing time series classification methods are generally based on a circular network structure to solve the point value coupling problem of time series, which cannot be computed in parallel, resulting in a waste of computing resources. Therefore, this paper proposes a time series classification method with local attention enhancement. The mixed distance information is fitted to increase the position information perception of time series, the mixed distance information is incorporated into the self-attention matrix calculation to expand the self-attention mechanism. Multi-scale convolution attention is constructed to obtain multi-scale local forward information to solve the attention confusion problem in point value calculation of standard self-attention mechanism. The improved self-attention mechanism is used to construct the sequential self-attention classification module, and the time series classification task is processed by parallel computation. The experimental results show that, compared with the existing time series classification methods, the time series classification method based on local attention enhancement can accelerate convergence and effectively improve the classification effect of time series. © 2024 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
引用
收藏
页码:189 / 197
页数:8
相关论文
共 17 条
[1]  
YANG M C, CHEN X D, CAI P, Et al., An overview of early time series classification methods, Journal of East China Normal University (Natural Science), 5, pp. 115-133, (2021)
[2]  
ZHANG Y W, WANG Z H, LIU H Y, Et al., Time series classification algorithm based on multi- scale residual FCN, Journal of Software, 33, 2, pp. 555-570
[3]  
LI H L, JIA R Y, TAN G Y., Fuzzy classification method of time series based on K- Shape, Journal of University of Electronic Science and Technology of China, 50, 6, pp. 899-906, (2021)
[4]  
XIAO Z, XU X, XING H, Et al., RTFN: a robust temporal feature network for time series classification, Information Sciences, 571, pp. 65-86, (2021)
[5]  
KWON D H, KIM J B, HEO J S, Et al., Time series classification of cryptocurrency price trend based on a recurrent LSTM neural network, Journal of Information Processing Systems, 15, 3, pp. 694-706, (2019)
[6]  
ELSAYED N, MAIDA A S, BAYOUMI M., Deep gated recurrent and convolutional network hybrid model for univariate time series classification, International Journal of Advanced Computer Science and Applications, 10, 5, (2019)
[7]  
LI X W, LIU S Y, GAO K L., Transient stability assessment of power system based on bidirectional long and short memory network and convolutional neural network, Science Technology and Engineering, 20, 7, pp. 2733-2739, (2020)
[8]  
LI T, ZHANG Y, WANG T., SRPM-CNN: a combined model based on slide relative position matrix and CNN for time series classification, Complex & Intelligent Systems, 7, 3, pp. 1619-1631, (2021)
[9]  
DE SANTANA CORREIA A, COLOMBINI E L., Attention, please! A survey of neural attention models in deep learning, Artificial Intelligence Review, 55, pp. 6037-6124, (2022)
[10]  
TAY Y, DEHGHANI M, BAHRI D, Et al., Efficient transformers: a survey, ACM Computing Surveys, 55, 6, (2022)