A cost-sensitive attention temporal convolutional network based on adaptive top-k differential evolution for imbalanced time-series classification

被引:20
作者
Zhang, Xiaocai [1 ]
Peng, Hui [2 ]
Zhang, Jianjia [3 ]
Wang, Yang [4 ]
机构
[1] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[2] Nanyang Technol Univ, Sch Biol Sci, Singapore 637551, Singapore
[3] Sun Yat Sen Univ, Sch Biomed Engn, Shenzhen 518107, Peoples R China
[4] Univ Technol Sydney, Fac Engn & IT, Data Sci Inst, Ultimo, NSW 2007, Australia
关键词
Imbalanced; Time-series classification (TSC); Cost-sensitive; Deep learning; Evolutionary; ANOMALY DETECTION; NEURAL-NETWORKS;
D O I
10.1016/j.eswa.2022.119073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imbalanced time-series classification (ITSC) is ubiquitous in many real-world applications. In this study, a novel cost-sensitive deep learning framework, namely ACS-ATCN, is proposed for ITSC. With the framework of ACS-ATCN, first, weighted class costs are optimized jointly with the hyperparameters of an attention temporal convolutional network (ATCN). Second, an improved evolutionary algorithm, termed adaptive top -k differential evolution (ATDE), is presented for optimizing class costs as well as the network's hyperparameter. Experiments on five data sets demonstrate that ACS-ATCN achieves a higher average G-mean than other cost-sensitive learning and oversampling algorithms while using much less computational time. Comparison between different deep learning frameworks also confirms its advantages over other existing benchmarking methods in ITSC. Experimental results also reveal that ATDE provides more accurate classification than the vanilla DE algorithm, and saves as high as 41.53% of average computational expense for convergence.
引用
收藏
页数:13
相关论文
共 78 条
[1]   Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles [J].
Bagnall, Anthony ;
Lines, Jason ;
Hills, Jon ;
Bostrom, Aaron .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (09) :2522-2535
[2]   Integrated Oversampling for Imbalanced Time Series Classification [J].
Cao, Hong ;
Li, Xiao-Li ;
Woon, David Yew-Kwong ;
Ng, See-Kiong .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (12) :2809-2822
[3]   Oversampling imbalanced data in the string space [J].
Castellanos, Francisco J. ;
Valero-Mas, Jose J. ;
Calvo-Zaragoza, Jorge ;
Rico-Juan, Juan R. .
PATTERN RECOGNITION LETTERS, 2018, 103 :32-38
[4]   Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data [J].
Castro, Cristiano L. ;
Braga, Antonio P. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (06) :888-899
[5]   Discrete Wavelet Transform-Based Time Series Analysis and Mining [J].
Chaovalit, Pimwadee ;
Gangopadhyay, Aryya ;
Karabatis, George ;
Chen, Zhiyuan .
ACM COMPUTING SURVEYS, 2011, 43 (02)
[6]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[7]   Deep Multiple Metric Learning for Time Series Classification [J].
Chen, Zhi ;
Liu, Yongguo ;
Zhu, Jiajing ;
Zhang, Yun ;
Li, Qiaoqin ;
Jin, Rongjiang ;
He, Xia .
IEEE ACCESS, 2021, 9 :17829-17842
[8]  
Cuturi M, 2017, PR MACH LEARN RES, V70
[9]  
Deng AL, 2021, AAAI CONF ARTIF INTE, V35, P4027
[10]   Joint imbalanced classification and feature selection for hospital readmissions [J].
Du, Guodong ;
Zhang, Jia ;
Luo, Zhiming ;
Ma, Fenglong ;
Ma, Lei ;
Li, Shaozi .
KNOWLEDGE-BASED SYSTEMS, 2020, 200