Time dimension feature extraction and classification of high-dimensional large data streams based on unsupervised learning

被引:0
作者
Jiang, Xiaobo [1 ]
Jiang, Yunchuan [2 ]
Liu, Leping [1 ]
Xia, Meng [1 ]
Jiang, Yunlu [3 ]
机构
[1] Guangdong Polytechn Sci & Technol, Comp Engn Tech Coll, Zhuhai, Guangdong, Peoples R China
[2] YongZhou Vocat Tech Coll, Div Basic Med, Dept Anat, Yongzhou 425100, Hunan, Peoples R China
[3] Jinan Univ, Sch Econ, Guangzhou, Guangdong, Peoples R China
关键词
Unsupervised learning; high dimensional big data flow; time dimension characteristics; low dimensional space; sliding window; discrete dyadic wavelet transform;
D O I
10.3233/JCM-237085
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In order to solve the problem of low accuracy of time dimension feature extraction and classification of high-dimensional large data streams, this paper proposes a time dimension feature extraction and classification algorithm of high-dimensional large data streams based on unsupervised learning. Analyze the trend of high-dimensional data flow changes under machine learning, and achieve dimensionality reduction of high-dimensional large traffic time dimensional data through local save projection. Analyze the spatial relationship between feature attributes and feature space, segment and fit high-dimensional big data streams and time dimensional feature data streams, further segment time dimensional sequences using sliding windows, and complete feature extraction through discrete dyadic wavelet transform. According to the clustering algorithm, cluster the time dimension feature data stream, calculate the cosine similarity of the feature data, model the time dimension feature stream of training samples, use the feature classification function to minimize the classification loss, and use unsupervised learning to achieve the final classification task. The test results show that this method can improve the temporal feature extraction and classification accuracy streams.
引用
收藏
页码:835 / 848
页数:14
相关论文
共 20 条
[1]   Depthgram: Visualizing outliers in high-dimensional functional data with application to fMRI data exploration [J].
Aleman-Gomez, Yasser ;
Arribas-Gil, Ana ;
Desco, Manuel ;
Elias, Antonio ;
Romo, Juan .
STATISTICS IN MEDICINE, 2022, 41 (11) :2005-2024
[2]   An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification [J].
Chen, Ke ;
Xue, Bing ;
Zhang, Mengjie ;
Zhou, Fengyu .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) :7172-7186
[3]   MING: An interpretative support method for visual exploration of multidimensional data [J].
Colange, Benoit ;
Vuillon, Laurent ;
Lespinats, Sylvain ;
Dutykh, Denys .
INFORMATION VISUALIZATION, 2022, 21 (03) :197-219
[4]   Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification [J].
Dong, Yanni ;
Liu, Quanwei ;
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1559-1572
[5]   Magnetic-resonance image segmentation based on improved variable weight multi-resolution Markov random field in undecimated complex wavelet domain* [J].
Fan, Hong ;
Sun, Yiman ;
Zhang, Xiaojuan ;
Zhang, Chengcheng ;
Li, Xiangjun ;
Wang, Yi .
CHINESE PHYSICS B, 2021, 30 (07)
[6]   Hellinger Distance Weighted Ensemble for imbalanced data stream classification [J].
Grzyb, Joanna ;
Klikowski, Jakub ;
Wozniak, Michal .
JOURNAL OF COMPUTATIONAL SCIENCE, 2021, 51
[7]   Self-organizing fuzzy inference ensemble system for big streaming data classification [J].
Gu, Xiaowei ;
Angelov, Plamen ;
Zhao, Zhijin .
KNOWLEDGE-BASED SYSTEMS, 2021, 218
[8]   Stream Classification Algorithm Based on Decision Tree [J].
Guo, Jinlin ;
Wang, Haoran ;
Li, Xinwei ;
Zhang, Li .
MOBILE INFORMATION SYSTEMS, 2021, 2021
[9]   Effective feature representation using symbolic approach for classification and clustering of big data [J].
Lavanya, P. G. ;
Kouser, K. ;
Suresha, Mallappa .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 173
[10]   Incremental semi-supervised Extreme Learning Machine for Mixed data stream classification [J].
Li, Qiude ;
Xiong, Qingyu ;
Ji, Shengfen ;
Yu, Yang ;
Wu, Chao ;
Gao, Min .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 185