Absolutely no free lunches!

被引:9
作者
Belot, Gordon [1 ]
机构
[1] Univ Michigan, Dept Philosophy, Ann Arbor, MI 48109 USA
关键词
Induction; Learning; Extrapolation; Forecasting; No-free-lunch theorems; INDUCTIVE INFERENCE; IDENTIFICATION; PROBABILITY; THEOREM; SETS;
D O I
10.1016/j.tcs.2020.09.013
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper is concerned with learners who aim to learn patterns in infinite binary sequences: shown longer and longer initial segments of a binary sequence, they either attempt to predict whether the next bit will be a 0 or will be a 1 or they issue forecast probabilities for these events. Several variants of this problem are considered. In each case, a no-free-lunch result of the following form is established: the problem of learning is a formidably difficult one, in that no matter what method is pursued, failure is incomparably more common that success; and difficult choices must be faced in choosing a method of learning, since no approach dominates all others in its range of success. In the simplest case, the comparison of the set of situations in which a method fails and the set of situations in which it succeeds is a matter of cardinality (countable vs. uncountable); in other cases, it is a topological matter (meagre vs. co-meagre) or a hybrid computational-topological matter (effectively meagre vs. effectively co-meagre). (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:159 / 180
页数:22
相关论文
共 71 条
[1]   INDUCTIVE INFERENCE - THEORY AND METHODS [J].
ANGLUIN, D ;
SMITH, CH .
COMPUTING SURVEYS, 1983, 15 (03) :237-269
[2]  
[Anonymous], 1972, Soviet Mathematics Doklady
[3]  
[Anonymous], 1966, Philosophy of Natural Science
[4]  
[Anonymous], 1934, FUND MATH
[5]  
[Anonymous], 1980, Graduate Texts in Mathematics
[6]  
[Anonymous], 1999, Convergence of Probability Measures
[7]  
BAEZDUARTE L, 1970, STUD APPL MATH, V49, P401
[8]   Equivalences between learning of data and probability distributions, and their applications [J].
Barmpalias, George ;
Fang, Nan ;
Stephan, Frank .
INFORMATION AND COMPUTATION, 2018, 262 :123-140
[9]  
Barzdin J. M., 1972, Information Processing 71 Proceedings of the IFIP Congress 1971 Volume 1, P81
[10]  
Bharat Rao R., 1995, Machine Learning. Proceedings of the Twelfth International Conference on Machine Learning, P471