Optimal Change-Point Detection With Training Sequences in the Large and Moderate Deviations Regimes

被引:0
作者
He, Haiyun [1 ]
Zhang, Qiaosheng [1 ]
Tan, Vincent Y. F. [1 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 119077, Singapore
基金
新加坡国家研究基金会;
关键词
Training; Error probability; Information theory; Bayes methods; Markov processes; Data models; Upper bound; Change-point detection; training sequences; error exponent; moderate deviations regime; optimal confidence width; BAYESIAN-APPROACH; MULTIPLE; CLASSIFICATION; CUSUM; TESTS;
D O I
10.1109/TIT.2021.3092753
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not known and can only be learned from the training sequences which are available. We further require the probability of the estimation error to decay either exponentially or sub-exponentially fast (corresponding respectively to the large and moderate deviations regimes in information theory parlance). Based on the training sequences as well as the test sequence consisting of a single change-point, we design a change-point estimator and further show that this estimator is optimal by establishing matching (strong) converses. This leads to a full characterization of the optimal confidence width (i.e., half the width of the confidence interval within which the true change-point is located at with high probability) as a function of the undetected error, under both the large and moderate deviations regimes.
引用
收藏
页码:6758 / 6784
页数:27
相关论文
共 56 条
[1]   Moderate Deviations in Channel Coding [J].
Altug, Yucel ;
Wagner, Aaron B. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (08) :4417-4426
[2]  
[Anonymous], 2011, INFORM THEORY CODING, DOI DOI 10.1017/CBO9780511921889
[3]  
[Anonymous], 2013, Nonparametric Methods in Change-Point Problems
[4]  
[Anonymous], 1993, DETECTION ABRUPT CHA
[5]   Narrowest-over-threshold detection of multiple change points and change-point-like features [J].
Baranowski, Rafal ;
Chen, Yining ;
Fryzlewicz, Piotr .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2019, 81 (03) :649-672
[6]   A BAYESIAN-ANALYSIS FOR CHANGE POINT PROBLEMS [J].
BARRY, D ;
HARTIGAN, JA .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (421) :309-319
[7]   Covert Communication Over Noisy Channels: A Resolvability Perspective [J].
Bloch, Matthieu R. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (05) :2334-2354
[8]   CONSISTENCIES AND RATES OF CONVERGENCE OF JUMP-PENALIZED LEAST SQUARES ESTIMATORS [J].
Boysen, Leif ;
Kempe, Angela ;
Liebscher, Volkmar ;
Munk, Axel ;
Wittich, Olaf .
ANNALS OF STATISTICS, 2009, 37 (01) :157-183
[9]   NONPARAMETRIC CHANGE-POINT ESTIMATION [J].
CARLSTEIN, E .
ANNALS OF STATISTICS, 1988, 16 (01) :188-197
[10]   Estimation and comparison of multiple change-point models [J].
Chib, S .
JOURNAL OF ECONOMETRICS, 1998, 86 (02) :221-241