ESTIMATION OF MUTUAL INFORMATION USING KERNEL DENSITY ESTIMATORS

被引:342
|
作者
MOON, YI
RAJAGOPALAN, B
LALL, U
机构
[1] Utah Water Research Laboratory, Utah State University, Logan
来源
PHYSICAL REVIEW E | 1995年 / 52卷 / 03期
关键词
D O I
10.1103/PhysRevE.52.2318
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
Mutual information is useful for investigating the dependence between two experimental time series. It is often used to establish an appropriate time delay in phase-portrait reconstruction from time-series data. A histogram based approach has been used so far to estimate the probabilities. It is shown here that kernel density estimation of the probability density functions needed in estimating the average mutual information across two coordinates can be more effective than the histogram method of Eraser and Swinney.
引用
收藏
页码:2318 / 2321
页数:4
相关论文
共 50 条
  • [1] Utilization distribution estimation using weighted kernel density estimators
    Fieberg, John
    JOURNAL OF WILDLIFE MANAGEMENT, 2007, 71 (05): : 1669 - 1675
  • [2] Mutual information independence model using kernel density estimation for segmenting and labeling sequential data
    Zhou, GD
    Yang, LP
    Su, J
    Ji, DH
    COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING, 2005, 3406 : 155 - 166
  • [3] Estimation of mutual information using copula density function
    Zeng, X.
    Durrani, T. S.
    ELECTRONICS LETTERS, 2011, 47 (08) : 493 - 494
  • [4] Semi-supervised Feature Selection by Mutual Information Based on Kernel Density Estimation
    Xu, Siqi
    Dai, Jianhua
    Shi, Hong
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 818 - 823
  • [5] Adaptive Clustering Using Kernel Density Estimators
    Steinwart, Ingo
    Sriperumbudur, Bharath K.
    Thomann, Philipp
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [6] Estimation of mutual information via quantum kernel methods
    Maeda, Yota
    Kawaguchi, Hideaki
    Tezuka, Hiroyuki
    QUANTUM MACHINE INTELLIGENCE, 2025, 7 (01)
  • [7] A Preliminary Study on Class Probability Estimation for Random Forest Using Kernel Density estimators
    Yang, Fan
    Peng, Piao
    Zhou, Qifeng
    2016 11TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE), 2016, : 118 - 122
  • [8] Bootstrap MISE Estimators to Obtain Bandwidth for Kernel Density Estimation
    Miecznikowski, Jeffrey C.
    Wang, Dongliang
    Hutson, Alan
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2010, 39 (07) : 1455 - 1469
  • [9] Density estimation based on pointwise mutual information
    Inoue, Akimitsu
    ECONOMICS BULLETIN, 2016, 36 (02): : 1138 - +
  • [10] The kernel mutual information
    Gretton, A
    Herbrich, R
    Smola, AJ
    2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PROCEEDINGS: SIGNAL PROCESSING FOR COMMUNICATIONS SPECIAL SESSIONS, 2003, : 880 - 883