Generalized kernel two-sample tests

被引:2
作者
Song, Hoseung [1 ]
Chen, Hao [1 ]
机构
[1] Univ Calif Davis, Dept Stat, One Shields Ave, Davis, CA 95616 USA
基金
美国国家科学基金会;
关键词
General alternative; High-dimensional data; Nonparametric test; Permutation null distribution; MULTIVARIATE; METRICS;
D O I
10.1093/biomet/asad068
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Kernel two-sample tests have been widely used for multivariate data to test equality of distributions. However, existing tests based on mapping distributions into a reproducing kernel Hilbert space mainly target specific alternatives and do not work well for some scenarios when the dimension of the data is moderate to high due to the curse of dimensionality. We propose a new test statistic that makes use of a common pattern under moderate and high dimensions and achieves substantial power improvements over existing kernel two-sample tests for a wide range of alternatives. We also propose alternative testing procedures that maintain high power with low computational cost, offering easy off-the-shelf tools for large datasets. The new approaches are compared to other state-of-the-art tests under various settings and show good performance. We showcase the new approaches through two applications: the comparison of musks and nonmusks using the shape of molecules, and the comparison of taxi trips starting from John F. Kennedy airport in consecutive months. All proposed methods are implemented in an R package kerTests.
引用
收藏
页码:755 / 770
页数:16
相关论文
共 27 条
  • [1] [Anonymous], 2024, R: A Language and Environment for Statistical Computing
  • [2] Balasubramanian Krishnakumar, 2021, JOURNAL OF MACHINE LEARNING RESEARCH, V22
  • [3] A nonparametric test for the general two-sample problem
    Baumgartner, W
    Weiss, P
    Schindler, H
    [J]. BIOMETRICS, 1998, 54 (03) : 1129 - 1135
  • [4] A nonparametric two-sample test applicable to high dimensional data
    Biswas, Munmun
    Ghosh, Anil K.
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2014, 123 : 160 - 171
  • [5] A new framework for distance and kernel-based metrics in high dimensions
    Chakraborty, Shubhadeep
    Zhang, Xianyang
    [J]. ELECTRONIC JOURNAL OF STATISTICS, 2021, 15 (02): : 5455 - 5522
  • [6] A New Graph-Based Two-Sample Test for Multivariate and Object Data
    Chen, Hao
    Friedman, Jerome H.
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (517) : 397 - 409
  • [7] ASYMPTOTIC DISTRIBUTION-FREE CHANGE- POINT DETECTION FOR MULTIVARIATE AND NON-EUCLIDEAN DATA
    Chu, Lynna
    Chen, Hao
    [J]. ANNALS OF STATISTICS, 2019, 47 (01) : 382 - 414
  • [8] MULTIVARIATE GENERALIZATIONS OF THE WALD-WOLFOWITZ AND SMIRNOV 2-SAMPLE TESTS
    FRIEDMAN, JH
    RAFSKY, LC
    [J]. ANNALS OF STATISTICS, 1979, 7 (04) : 697 - 717
  • [9] Gao Hongcheng, 2023, arXiv
  • [10] Gretton A., 2012, Advances in neural information processing systems