Time series outlier detection and imputation

被引:0
作者
Akouemo, Hermine N. [1 ]
Povinelli, Richard J. [1 ]
机构
[1] Marquette Univ, Dept Elect & Comp Engn, Milwaukee, WI 53233 USA
来源
2014 IEEE PES GENERAL MEETING - CONFERENCE & EXPOSITION | 2014年
关键词
outlier; hypothesis testing; time series; ARIMAX; imputation;
D O I
暂无
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
This paper proposed the combination of two statistical techniques for the detection and imputation of outliers in time series data. An autoregressive integrated moving average with exogenous inputs (ARIMAX) model is used to extract the characteristics of the time series and to find the residuals. The outliers are detected by performing hypothesis testing on the extrema of the residuals and the anomalous data are imputed using another ARIMAX model. The process is performed in an iterative way because at the beginning the process, the residuals are contaminated by the anomalies and therefore, the ARIMAX model needs to be re-learned on "cleaner" data at every step. We test the algorithm using both synthetic and real data sets and we present the analysis and comments on those results.
引用
收藏
页数:5
相关论文
共 24 条
[1]   Outlier mining in large high-dimensional data sets [J].
Angiulli, F ;
Pizzuti, C .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (02) :203-215
[2]  
[Anonymous], 1980, IDENTIFICATION OUTLI, DOI DOI 10.1007/978-94-015-3994-4
[3]  
[Anonymous], 2006, Time series analysis
[4]   Outlier detection in regression models with ARIMA errors using robust estimates [J].
Bianco, AM ;
Ben, MG ;
Martínez, EJ ;
Yohai, VJ .
JOURNAL OF FORECASTING, 2001, 20 (08) :565-579
[5]  
Box G.E.P., 2008, TIME SERIES ANAL
[6]   Outlier detection in large data sets [J].
Buzzi-Ferraris, Guido ;
Manenti, Flavio .
COMPUTERS & CHEMICAL ENGINEERING, 2011, 35 (02) :388-390
[7]   ESTIMATION OF TIME-SERIES PARAMETERS IN THE PRESENCE OF OUTLIERS [J].
CHANG, I ;
TIAO, GC ;
CHEN, C .
TECHNOMETRICS, 1988, 30 (02) :193-204
[8]   Outlier detection for stationary time series [J].
Choy, K .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2001, 99 (02) :111-127
[9]   ROBUST ESTIMATION OF THE 1ST-ORDER AUTOREGRESSIVE PARAMETER [J].
DENBY, L ;
MARTIN, RD .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1979, 74 (365) :140-146
[10]  
Fauconnier C., 2009, Statistical Methodology, V6, P363, DOI [10.1016/j.stamet.2008.12.005, DOI 10.1016/J.STAMET.2008.12.005]