Probabilistic anomaly detection in natural gas time series data

被引:69
作者
Akouemo, Hermine N. [1 ]
Povinelli, Richard J. [1 ]
机构
[1] Marquette Univ, Dept Elect & Comp Engn, Milwaukee, WI 53233 USA
关键词
Data cleaning; Energy; Outlier detection; Linear regression; Bayesian classifier; Gaussian mixture models; OUTLIERS;
D O I
10.1016/j.ijforecast.2015.06.001
中图分类号
F [经济];
学科分类号
02 ;
摘要
This paper introduces a probabilistic approach to anomaly detection, specifically in natural gas time series data. In the natural gas field, there are various types of anomalies, each of which is induced by a range of causes and sources. The causes of a set of anomalies are examined and categorized, and a Bayesian maximum likelihood classifier learns the temporal structures of known anomalies. Given previously unseen time series data, the system detects anomalies using a linear regression model with weather inputs, after which the anomalies are tested for false positives and classified using a Bayesian classifier. The method can also identify anomalies of an unknown origin. Thus, the likelihood of a data point being anomalous is given for anomalies of both known and unknown origins. This probabilistic anomaly detection method is tested on a reported natural gas consumption data set. (C) 2015 International Institute of Forecasters. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:948 / 956
页数:9
相关论文
共 29 条
[1]  
Adnan R., 2003, Matematika, V1, P29
[2]  
Akouemo Hermine N., 2014, 2014 IEEE PES General Meeting: Conference & Exposition, DOI 10.1109/PESGM.2014.6939802
[3]  
[Anonymous], 1980, IDENTIFICATION OUTLI, DOI DOI 10.1007/978-94-015-3994-4
[4]   Forecasting residential natural gas demand [J].
Aras, H ;
Aras, N .
ENERGY SOURCES, 2004, 26 (05) :463-472
[5]  
BARBER D., 2012, Bayesian Reasoning and Machine Learning
[6]   Short-term prediction of household electricity consumption: Assessing weather sensitivity in a Mediterranean area [J].
Beccali, M. ;
Cellura, M. ;
Lo Brano, V. ;
Marvuglia, A. .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2008, 12 (08) :2040-2065
[7]   A Probabilistic Combination Approach to Improve Outlier Detection [J].
Bouguessa, Mohamed .
2012 IEEE 24TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2012), VOL 1, 2012, :666-673
[8]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104
[9]   ESTIMATION OF TIME-SERIES PARAMETERS IN THE PRESENCE OF OUTLIERS [J].
CHANG, I ;
TIAO, GC ;
CHEN, C .
TECHNOMETRICS, 1988, 30 (02) :193-204
[10]   Wavelet-based detection of outliers in financial time series [J].
Grane, Aurea ;
Veiga, Helena .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2010, 54 (11) :2580-2593