Sequential Nonparametric Tests for a Change in Distribution: An Application to Detecting Radiological Anomalies

被引:13
作者
Padilla, Oscar Hernan Madrid [1 ]
Athey, Alex [2 ]
Reinhart, Alex [3 ]
Scott, James G. [4 ,5 ]
机构
[1] Univ Calif Berkeley, Dept Stat, Berkeley, CA 94720 USA
[2] Univ Texas Austin, Appl Res Labs, Austin, TX USA
[3] Carnegie Mellon Univ, Dept Stat, Pittsburgh, PA 15213 USA
[4] Univ Texas Austin, Dept Stat & Data Sci, Austin, TX 78712 USA
[5] Univ Texas Austin, McCombs Sch Business, Austin, TX 78712 USA
关键词
Anomaly detection; Kolmogorov-Smirnov test; Radiological survey; Sequential testing;
D O I
10.1080/01621459.2018.1476245
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We propose a sequential nonparametric test for detecting a change in distribution, based on windowed Kolmogorov-Smirnov statistics. The approach is simple, robust, highly computationally efficient, easy to calibrate, and requires no parametric assumptions about the underlying null and alternative distributions. We show that both the false-alarm rate and the power of our procedure are amenable to rigorous analysis, and that the method outperforms existing sequential testing procedures in practice. We then apply the method to the problem of detecting radiological anomalies, using data collected from measurements of the background gamma-radiation spectrum on a large university campus. In this context, the proposed method leads to substantial improvements in time-to-detection for the kind of radiological anomalies of interest in law-enforcement and border-security applications.Supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.
引用
收藏
页码:514 / 528
页数:15
相关论文
共 45 条
[11]   α-investing:: a procedure for sequential control of expected false discoveries [J].
Foster, Dean P. ;
Stine, Robert A. .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :429-444
[12]  
Gaffigan M., 2012, GAO12925
[13]  
Hawkins D., 1988, SEQUENTIAL ANAL, V7, P23
[14]   Parametric and Nonparametric Analysis of Eye-Tracking Data by Anomaly Detection [J].
Jansson, Daniel ;
Rosen, Olov ;
Medvedev, Alexander .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2015, 23 (04) :1578-1586
[15]   ONLINE RULES FOR CONTROL OF FALSE DISCOVERY RATE AND FALSE DISCOVERY EXCEEDANCE [J].
Javanmard, Adel ;
Montanari, Andrea .
ANNALS OF STATISTICS, 2018, 46 (02) :526-554
[16]   UNIFORM CHANGE POINT TESTS IN HIGH DIMENSION [J].
Jirak, Moritz .
ANNALS OF STATISTICS, 2015, 43 (06) :2451-2483
[18]  
Lai TL, 2001, STAT SINICA, V11, P303
[19]   Information bounds and quick detection of parameter changes in stochastic systems [J].
Lai, TL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (07) :2917-2929
[20]   Nonanticipating estimation applied to sequential analysis and changepoint detection [J].
Lorden, G ;
Pollak, M .
ANNALS OF STATISTICS, 2005, 33 (03) :1422-1454