Large and Small Deviations for Statistical Sequence Matching

被引:0
作者
Zhou, Lin [1 ]
Wang, Qianyun [1 ]
Wang, Jingjing [1 ]
Bai, Lin [1 ]
Hero III, Alfred O. [2 ]
机构
[1] Beihang Univ, Sch Cyber Sci & Technol, Beijing 100191, Peoples R China
[2] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
基金
中国国家自然科学基金;
关键词
Databases; Testing; Probability; Error probability; Training; Accuracy; Vectors; Finite blocklength analysis; classification; second-order asymptotics; mismatch; false alarm; CLASSIFICATION; REFINEMENT; CHANNELS; TESTS;
D O I
10.1109/TIT.2024.3464586
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We revisit the problem of statistical sequence matching between two databases of sequences initiated by Unnikrishnan, (2015) and derive theoretical performance guarantees for the generalized likelihood ratio test (GLRT). We first consider the case where the number of matched pairs of sequences between the databases is known. In this case, the task is to accurately find the matched pairs of sequences among all possible matches between the sequences in the two databases. We analyze the performance of the GLRT by Unnikrishnan and explicitly characterize the tradeoff between the mismatch and false reject probabilities under each hypothesis in both large and small deviations regimes. Furthermore, we demonstrate the optimality of Unnikrishnan's GLRT test under the generalized Neyman-Person criterion for both regimes and illustrate our theoretical results via numerical examples. Subsequently, we generalize our achievability analyses to the case where the number of matched pairs is unknown, and an additional error probability needs to be considered. When one of the two databases contains a single sequence, the problem of statistical sequence matching specializes to the problem of multiple classification introduced by Gutman, (1989). For this special case, our result for the small deviations regime strengthens previous result of Zhou et al., (2020) by removing unnecessary conditions on the generating distributions.
引用
收藏
页码:7532 / 7562
页数:31
相关论文
共 46 条
  • [1] Ahlswede R, 2006, LECT NOTES COMPUT SC, V4123, P553
  • [2] Ahlswede R., 1987, SEARCH PROBLEMS
  • [3] Refinement of the Random Coding Bound
    Altug, Yuecel
    Wagner, Aaron B.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (10) : 6005 - 6023
  • [4] Refinement of the Sphere-Packing Bound: Asymmetric Channels
    Altug, Yuecel
    Wagner, Aaron B.
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (03) : 1592 - 1614
  • [5] Testing Closeness of Discrete Distributions
    Batu, Tugkan
    Fortnow, Lance
    Rubinfeld, Ronitt
    Smith, Warren D.
    White, Patrick
    [J]. JOURNAL OF THE ACM, 2013, 60 (01)
  • [6] On the dependence of the Berry-Esseen bound on dimension
    Bentkus, V
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2003, 113 (02) : 385 - 402
  • [7] HYPOTHESIS TESTING AND INFORMATION-THEORY
    BLAHUT, RE
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1974, 20 (04) : 405 - 417
  • [8] Boyd S., 2004, Convex Optimization, DOI [10.1017/CBO9780511804441, DOI 10.1017/CBO9780511804441]
  • [9] The method of types
    Csiszar, I
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (06) : 2505 - 2523
  • [10] Dembo Amir, 2009, Large Deviations Techniques and Applications. Stochastic Modelling and Applied Probability