Ramp loss K-Support Vector Classification-Regression; a robust and sparse multi-class approach to the intrusion detection problem

被引:77
|
作者
Bamakan, Seyed Mojtaba Hosseini [1 ,2 ,3 ]
Wang, Huadong [1 ,2 ]
Shi, Yong [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Key Lab Big Data Min & Knowledge Management, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Res Ctr Fictitious Econ & Data Sci, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Econ & Management, Beijing 100190, Peoples R China
[4] Univ Nebraska, Coll Informat Sci & Technol, Omaha, NE 68182 USA
关键词
Multi-Class classification; Intrusion detection; K-Support Vector Classification-Regression; Ramp loss function; Alternating Direction Method of Multipliers (ADMM); Concave-Convex Procedure (CCCP); FEATURE-SELECTION; DETECTION SYSTEM; ANOMALY DETECTION; INCREMENTAL SVM; OPTIMIZATION; MACHINE; ALGORITHM; SOM;
D O I
10.1016/j.knosys.2017.03.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Network intrusion detection problem is an ongoing challenging research area because of a huge number of traffic volumes, extremely imbalanced data sets, multi-class of attacks, constantly changing the nature of new attacks and the attackers' methods. Since the traditional network protection methods fail to adequately protect the computer networks, the need for some sophisticated methodologies has been felt. In this paper, we develop a precise, sparse and robust methodology for multi-class intrusion detection problem based on the Ramp Loss K-Support Vector Classification-Regression, named "Ramp-KSVCR". The main objectives of this research are to address the following issues; 1) Highly imbalanced and skewed attacks' distribution; hence, we utilized the K-SVCR model as a core of our model; 2) Sensitivity of SVM and its extensions to the presence of noises and outliers in the training sets, to cope with this problem, Ramp loss function is implemented to our model; 3) and since the proposed Ramp-KSVCR model is a non-differentiable non-convex optimization problem, we took Concave-Convex Procedure (CCCP) to solve this model. Furthermore, we introduced Alternating Direction Method of Multipliers (ADMM) procedure to make our model well-adapted to be applicable in the large-scale setting and to reduce the training time. The performance of the proposed method has been evaluated by some artificial data and also by conducting some experiments with the NSL-KDD data set and UNSW-NB15 as a recently published intrusion detection data set. Experimental results not only demonstrate the superiority of the proposed method over the traditional approaches tested against it in terms of generalization power and sparsity but also saving a considerable amount of computational time. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:113 / 126
页数:14
相关论文
共 30 条
  • [1] Ramp loss for twin multi-class support vector classification
    Wang, Huiru
    Lu, Sijie
    Zhou, Zhijian
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2020, 51 (08) : 1448 - 1463
  • [2] Robust weighted linear loss twin multi-class support vector regression for large-scale classification
    Qiang, Wenwen
    Zhang, Jinxin
    Zhen, Ling
    Jing, Ling
    SIGNAL PROCESSING, 2020, 170
  • [3] Ramp-loss nonparallel support vector regression: Robust, sparse and scalable approximation
    Tang, Long
    Tian, Yingjie
    Yang, Chunyan
    Pardalos, Panos M.
    KNOWLEDGE-BASED SYSTEMS, 2018, 147 : 55 - 67
  • [4] Network Intrusion Detection Based on Multi-Class Support Vector Machine
    Anh Vu Le
    Hoai An Le Thi
    Manh Cuong Nguyen
    Zidna, Ahmed
    COMPUTATIONAL COLLECTIVE INTELLIGENCE - TECHNOLOGIES AND APPLICATIONS, PT I, 2012, 7653 : 536 - 543
  • [5] Multi-class Classification using Support Vector Regression Machine with Consistency
    Jia, Wei
    Liang, Junli
    Zhang, Miaohua
    Ye, Xin
    2015 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), 2015, : 848 - 851
  • [6] Generalization and learning rate of multi-class support vector classification and regression
    Dong, Zijie
    Gong, Jiawen
    Zou, Bin
    Wang, Yichi
    Xu, Jie
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2022, 20 (05)
  • [7] Ramp loss KNN-weighted multi-class twin support vector machine
    Huiru Wang
    Yitian Xu
    Zhijian Zhou
    Soft Computing, 2022, 26 : 6591 - 6618
  • [8] Ramp loss KNN-weighted multi-class twin support vector machine
    Wang, Huiru
    Xu, Yitian
    Zhou, Zhijian
    SOFT COMPUTING, 2022, 26 (14) : 6591 - 6618
  • [9] K-SVCR.: A support vector machine for multi-class classification
    Angulo, C
    Parra, X
    Català, A
    NEUROCOMPUTING, 2003, 55 (1-2) : 57 - 77
  • [10] Ramp loss one-class support vector machine; A robust and effective approach to anomaly detection problems
    Tian, Yingjie
    Mirzabagheri, Mahboubeh
    Bamakan, Seyed Mojtaba Hosseini
    Wang, Huadong
    Qu, Qiang
    NEUROCOMPUTING, 2018, 310 : 223 - 235