Graph-based predictable feature analysis

被引:0
作者
Björn Weghenkel
Asja Fischer
Laurenz Wiskott
机构
[1] Ruhr University Bochum,Institute for Neural Computation
[2] University of Bonn,Computer Science Institute
来源
Machine Learning | 2017年 / 106卷
关键词
Unsupervised learning; Dimensionality reduction; Feature learning; Representation learning; Graph embedding; Predictability;
D O I
暂无
中图分类号
学科分类号
摘要
We propose graph-based predictable feature analysis (GPFA), a new method for unsupervised learning of predictable features from high-dimensional time series, where high predictability is understood very generically as low variance in the distribution of the next data point given the previous ones. We show how this measure of predictability can be understood in terms of graph embedding as well as how it relates to the information-theoretic measure of predictive information in special cases. We confirm the effectiveness of GPFA on different datasets, comparing it to three existing algorithms with similar objectives—namely slow feature analysis, forecastable component analysis, and predictable feature analysis—to which GPFA shows very competitive results.
引用
收藏
页码:1359 / 1380
页数:21
相关论文
共 36 条
  • [1] Belkin M(2003)Laplacian eigenmaps for dimensionality reduction and data representation Neural Computation 15 1373-1396
  • [2] Niyogi P(2001)Predictability, complexity, and learning Neural Computation 13 2409-2463
  • [3] Bialek W(1985)Non parametric time series analysis and prediction: Uniform almost sure convergence of the window and k-nn autoregression estimates Statistics: A Journal of Theoretical and Applied Statistics 16 297-307
  • [4] Nemenman I(2008)Predictive coding and the slowness principle: An information-theoretic approach Neural Computation 20 1026-1041
  • [5] Tishby N(2012)Slow feature analysis: Perspectives for technical applications of a versatile learning algorithm Künstliche Intelligenz (Artificial Intelligence) 26 341-348
  • [6] Collomb G(2013)How to solve classification and regression problems on high-dimensional data with a supervised extension of slow feature analysis Journal of Machine Learning Research 14 3683-3719
  • [7] Creutzig F(2015)Learning state representations with robotic priors Autonomous Robots 39 407-428
  • [8] Sprekeler H(2012)The Mario AI benchmark and competitions IEEE Transactions on Computational Intelligence and AI in Games 4 55-67
  • [9] Escalante B(2000)Nonlinear dimensionality reduction by locally linear embedding Science 290 2323-2326
  • [10] Alberto N(2001)Computational mechanics: Pattern and prediction, structure and simplicity Journal of Satistical Physics 104 817-879