Iterative learning from positive data and counters

被引:1
作者
Koetzing, Timo [1 ]
机构
[1] Max Planck Inst Informat, Dept Algorithms & Complex 1, D-66123 Saarbrucken, Germany
关键词
Inductive inference; Function learning; Iterative learning; Transductive learning; MEMORY;
D O I
10.1016/j.tcs.2013.09.023
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We analyze iterative learning in the limit from positive data with the additional information provided by a counter. The simplest type of counter provides the current iteration number (counting up from 0 to infinity), which is known to improve learning power over plain iterative learning. We introduce five other (weaker) counter types, for example only providing some unbounded and non-decreasing sequence of numbers. Analyzing these types allows one to understand which properties of a counter learning can benefit from. For the iterative setting, we completely characterize the relative power of the learning criteria corresponding to the counter types. In particular, for our types, the only properties improving learning power are unboundedness and strict monotonicity. Furthermore, we show that each of our types of counter improves learning power over weaker ones in some settings; to this end, we analyze transductive and non-U-shaped learning. Finally we show that, for iterative learning criteria with one of our types of counter, separations of learning criteria are necessarily witnessed by classes containing only infinite languages. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:155 / 169
页数:15
相关论文
共 22 条
  • [1] [Anonymous], 1987, THEORY RECURSIVE FUN
  • [2] [Anonymous], INFORM CONTR
  • [3] When unlearning helps
    Baliga, Ganesh
    Case, John
    Merkle, Wolfgang
    Stephan, Frank
    Wiehagen, Rolf
    [J]. INFORMATION AND COMPUTATION, 2008, 206 (05) : 694 - 709
  • [4] Results on memory-limited U-shaped learning
    Carlucci, Lorenzo
    Case, John
    Jain, Sanjay
    Stephan, Frank
    [J]. INFORMATION AND COMPUTATION, 2007, 205 (10) : 1551 - 1573
  • [5] Incremental concept learning for bounded data mining
    Case, J
    Jain, S
    Lange, S
    Zeugmann, T
    [J]. INFORMATION AND COMPUTATION, 1999, 152 (01) : 74 - 110
  • [6] INFINITARY SELF-REFERENCE IN LEARNING-THEORY
    CASE, J
    [J]. JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 1994, 6 (01) : 3 - 16
  • [7] Case J., 1974, Mathematical Systems Theory, V8, P15, DOI 10.1007/BF01761704
  • [8] Case J., 2011, P STACS S THEOR ASP, P320
  • [9] Case J., 2010, P COLT C LEARN THEOR, P181
  • [10] U-shaped, iterative, and iterative-with-counter learning
    Case, John
    Moelius, Samuel E., III
    [J]. MACHINE LEARNING, 2008, 72 (1-2) : 63 - 88