JOINT SEQUENTIAL DETECTION AND ISOLATION FOR DEPENDENT DATA STREAMS

被引:0
作者
Chaudhuri, Anamitra [1 ]
Fellouris, Georgios [1 ]
机构
[1] Univ Illinois, Dept Stat, Champaign, IL 61820 USA
关键词
Sequential multiple testing; detection and isolation; anomaly detection; asymptotic optimality; dependence structure; PRIOR INFORMATION; TESTS; INDEPENDENCE; SEARCH; NUMBER;
D O I
10.1214/24-AOS2385
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The problem of joint sequential detection and isolation is considered in the context of multiple, not necessarily independent, data streams. A multiple testing framework is proposed, where each hypothesis corresponds to a different subset of data streams, the sample size is a stopping time of the observations, and the probabilities of four kinds of error are controlled below distinct, user-specified levels. Two of these errors reflect the detection component of the formulation, whereas the other two the isolation component. The optimal expected sample size is characterized to a first-order asymptotic approximation as the error probabilities go to 0. Different asymptotic regimes, expressing different prioritizations of the detection and isolation tasks, are considered. A novel, versatile family of testing procedures is proposed, in which two distinct, in general, statistics are computed for each hypothesis, one addressing the detection task and the other the isolation task. Tests in this family, of various computational complexities, are shown to be asymptotically optimal under different setups. The general theory is applied to the detection and isolation of anomalous, not necessarily independent, data streams, as well as to the detection and isolation of an unknown dependence structure.
引用
收藏
页码:1899 / 1926
页数:28
相关论文
共 49 条
[1]   Detection of Gauss-Markov Random Fields With Nearest-Neighbor Dependency [J].
Anandkumar, Animashree ;
Tong, Lang ;
Swami, Ananthram .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (02) :816-827
[2]   DETECTION OF CORRELATIONS [J].
Arias-Castro, Ery ;
Bubeck, Sebastien ;
Lugosi, Gabor .
ANNALS OF STATISTICS, 2012, 40 (01) :412-435
[3]   Testing the independence of two non-stationary random processes with applications to biometric authentication [J].
Balakirsky, Vladimir B. ;
Ghazaryan, Anahit R. ;
Vinck, A. J. Han .
2007 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS, VOLS 1-7, 2007, :2671-2675
[4]  
Bartroff J, 2013, SPRINGER SER STAT, P1, DOI 10.1007/978-1-4614-6114-2
[5]   MULTIPLE HYPOTHESIS TESTS CONTROLLING GENERALIZED ERROR RATES FOR SEQUENTIAL DATA [J].
Bartroff, Jay .
STATISTICA SINICA, 2018, 28 (01) :363-398
[6]   Sequential tests of multiple hypotheses controlling type I and II familywise error rates [J].
Bartroff, Jay ;
Song, Jinlin .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2014, 153 :100-114
[7]   Multistage Tests of Multiple Hypotheses [J].
Bartroff, Jay ;
Lai, Tze Leung .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2010, 39 (8-9) :1597-1607
[8]  
Bolognani S, 2013, IEEE DECIS CONTR P, P1659, DOI 10.1109/CDC.2013.6760120
[9]   Optimal hypothesis testing for high dimensional covariance matrices [J].
Cai, T. Tony ;
Ma, Zongming .
BERNOULLI, 2013, 19 (5B) :2359-2388
[10]   LIMITING LAWS OF COHERENCE OF RANDOM MATRICES WITH APPLICATIONS TO TESTING COVARIANCE STRUCTURE AND CONSTRUCTION OF COMPRESSED SENSING MATRICES [J].
Cai, T. Tony ;
Jiang, Tiefeng .
ANNALS OF STATISTICS, 2011, 39 (03) :1496-1525