anomalyDetection: Implementation of Augmented Network Log Anomaly Detection Procedures

被引:7
作者
Gutierrez, Robert J. [1 ]
Boehmke, Bradley C. [1 ]
Bauer, Kenneth W. [1 ]
Saie, Cade M. [1 ]
Bihl, Trevor J. [1 ]
机构
[1] US Air Force, Inst Technol, 2950 Hobson Way, Wright Patterson AFB, OH 45433 USA
关键词
EXPLORATORY FACTOR-ANALYSIS; INTRUSION-DETECTION;
D O I
10.32614/RJ-2017-039
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
As the number of cyber-attacks continues to grow on a daily basis, so does the delay in threat detection. For instance, in 2015, the Office of Personnel Management discovered that approximately 21.5 million individual records of Federal employees and contractors had been stolen. On average, the time between an attack and its discovery is more than 200 days. In the case of the OPM breach, the attack had been going on for almost a year. Currently, cyber analysts inspect numerous potential incidents on a daily basis, but have neither the time nor the resources available to perform such a task. anomalyDetection aims to curtail the time frame in which anomalous cyber activities go unnoticed and to aid in the efficient discovery of these anomalous transactions among the millions of daily logged events by i) providing an efficient means for pre-processing and aggregating cyber data for analysis by employing a tabular vector transformation and handling multicollinearity concerns; ii) offering numerous built-in multivariate statistical functions such as Mahalanobis distance, factor analysis, principal components analysis to identify anomalous activity, iii) incorporating the pipe operator (%>%) to allow it to work well in the tidyverse workflow. Combined, anomalyDetection offers cyber analysts an efficient and simplified approach to break up network events into time-segment blocks and identify periods associated with suspected anomalies for further evaluation.
引用
收藏
页码:354 / 365
页数:12
相关论文
共 20 条
[1]  
[Anonymous], MAGRITTR FORWARD PIP
[2]  
[Anonymous], 2017, EASILY INSTALL LOAD
[3]  
Boehmke B., 2017, ANOMALYDETECTION IMP
[4]   Anomaly detection from log files using data mining techniques [J].
Breier, Jakub ;
Branišová, Jana .
Lecture Notes in Electrical Engineering, 2015, 339 :449-457
[5]   AN INTRUSION-DETECTION MODEL [J].
DENNING, DE .
IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 1987, 13 (02) :222-232
[6]   Evaluating the use of exploratory factor analysis in psychological research [J].
Fabrigar, LR ;
Wegener, DT ;
MacCallum, RC ;
Strahan, EJ .
PSYCHOLOGICAL METHODS, 1999, 4 (03) :272-299
[7]   Anomaly-based network intrusion detection: Techniques, systems and challenges [J].
Garcia-Teodoro, P. ;
Diaz-Verdejo, J. ;
Macia-Fernandez, G. ;
Vazquez, E. .
COMPUTERS & SECURITY, 2009, 28 (1-2) :18-28
[8]   Developing expertise for network intrusion detection [J].
Goodall, John R. ;
Lutters, Wayne G. ;
Komlodi, Anita .
INFORMATION TECHNOLOGY & PEOPLE, 2009, 22 (02) :92-108
[9]   Design and Analysis of a Dynamically Configured Log-based Distributed Security Event Detection Methodology [J].
Grimaila, Michael R. ;
Myers, Justin ;
Mills, Robert F. ;
Peterson, Gilbert .
JOURNAL OF DEFENSE MODELING AND SIMULATION-APPLICATIONS METHODOLOGY TECHNOLOGY-JDMS, 2012, 9 (03) :219-241
[10]  
Gutierrez R., 2017, J ALGORITHM IN PRESS