Large-Scale and Robust Intrusion Detection Model Combining Improved Deep Belief Network With Feature-Weighted SVM

被引:30
作者
Wu, Yukun [1 ,2 ]
Lee, Wei William [1 ]
Xu, Zhicheng [1 ]
Ni, Minya [1 ]
机构
[1] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou 310023, Peoples R China
[2] Zhejiang Post & Telecommun Coll, Shaoxing 312366, Peoples R China
基金
中国国家自然科学基金;
关键词
Intrusion detection; Support vector machines; Feature extraction; Training; Mathematical model; Machine learning; Computational modeling; feature redundancy; deep belief network; feature extraction; NSL-KDD; LEARNING APPROACH;
D O I
10.1109/ACCESS.2020.2994947
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In a large-scale data environment, the 'curse of dimensionality' of high-dimensional feature spaces and the large amount of noisy data make the efficiency and accuracy of intrusion detection systems (IDSs) significantly decrease. To address these challenges, the underlying algorithm can not only reduce dimensionality, but also remove some redundant and irrelevant noise data from the massive data. Accordingly, herein, an IDS combining deep belief network (DBN) with feature-weighted support vector machines (WSVM) is proposed. First, an adaptive learning rate strategy is applied to promote the training performance of the IDBN, which is used for learning deep features from raw data for reducing dimensionality. Second, the particle swarm optimization algorithm is used to optimize the SVM, followed by the determination of the weights of deep features and the best parameters of the Gaussian kernel, resulting in WSVM which can remove weakly related and redundant features from all IDBN-extracted features. The NSL-KDD dataset was used to validate the IDBN-WSVM model. In particular, the model performance was studied and compared to a model comprising a non-weighted SVM and other machine learning methods. Experimental results demonstrate that IDBN-WSVM is well-suited for designing high-precision classification models. The proposed improved model achieves accuracies of 85.73% and 82.36% in binary- and five-category classification experiments, respectively, which is better than or near state-of-the-art method. The IDBN-WSVM model not only saves training time and testing time on large-scale datasets, but also is more robust and has better performance of generalization than traditional methods, which provides a new research method that achieves high accuracy in intrusion detection tasks.
引用
收藏
页码:98600 / 98611
页数:12
相关论文
共 40 条
[1]  
Alom MZ, 2015, PROC NAECON IEEE NAT, P339, DOI 10.1109/NAECON.2015.7443094
[2]  
Alrawashdeh K, 2016, 2016 15TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2016), P195, DOI [10.1109/ICMLA.2016.0040, 10.1109/ICMLA.2016.167]
[3]  
[Anonymous], 2003, PROC 23 WORKSHOP PRO
[4]   Fuzziness based semi-supervised learning approach for intrusion detection system [J].
Ashfaq, Rana Aamir Raza ;
Wang, Xi-Zhao ;
Huang, Joshua Zhexue ;
Abbas, Haider ;
He, Yu-Lin .
INFORMATION SCIENCES, 2017, 378 :484-497
[5]  
Bhattacharjee P.S., 2017, Adv. Comput. Sci. Technol, V10, P235
[6]   A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection [J].
Buczak, Anna L. ;
Guven, Erhan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2016, 18 (02) :1153-1176
[7]   Feature selection by multi-objective optimisation: Application to network anomaly detection by hierarchical self-organising maps [J].
de la Hoz, Emiro ;
de la Hoz, Eduardo ;
Ortiz, Andres ;
Ortega, Julio ;
Martinez-Alvarez, Antonio .
KNOWLEDGE-BASED SYSTEMS, 2014, 71 :322-338
[8]  
Ding YX, 2016, IEEE IJCNN, P3901, DOI 10.1109/IJCNN.2016.7727705
[9]   A Supervised Learning and Control Method to Improve Particle Swarm Optimization Algorithms [J].
Dong, Wenyong ;
Zhou, MengChu .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (07) :1135-1148
[10]   A Review on Swarm Intelligence and Evolutionary Algorithms for Solving Flexible Job Shop Scheduling Problems [J].
Gao, Kaizhou ;
Cao, Zhiguang ;
Zhang, Le ;
Chen, Zhenghua ;
Han, Yuyan ;
Pan, Quanke .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2019, 6 (04) :904-916