Learning nested differences in the presence of malicious noise

被引:9
作者
Auer, P
机构
[1] Graz University of Technology, A-8010 Graz
关键词
D O I
10.1016/S0304-3975(97)00019-4
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present a PAC-learning algorithm and anon-line learning algorithm for nested differences of intersection-closed classes. Examples of intersection-closed classes include axis-parallel rectangles, monomials, and linear sub-spaces. Our PAC-learning algorithm uses a pruning technique that we rigorously proof correct. As a result we show that the tolerable noise rate for this algorithm does not depend on the complexity (VC-dimension) of the target class but only on the VC-dimension of the underlying intersection-closed class. For out-on-line algorithm lye show an optimal mistake bound in the sense that there are concept classes for which each on-line learning algorithm (using nested differences as hypotheses) can be forced to make at least thai many mistakes.
引用
收藏
页码:159 / 175
页数:17
相关论文
共 16 条
[1]  
Angluin D., 1988, Machine Learning, V2, P319, DOI 10.1007/BF00116828
[2]   A RESULT OF VAPNIK WITH APPLICATIONS [J].
ANTHONY, M ;
SHAWETAYLOR, J .
DISCRETE APPLIED MATHEMATICS, 1993, 47 (03) :207-217
[3]  
Aslam J. A., 1995, Proceedings of the Eighth Annual Conference on Computational Learning Theory, P437, DOI 10.1145/225298.225351
[4]  
AUER P, 1993, 6TH P ANN ACM C COMP, P253
[5]  
AUER P, 1994, LECTURE NOTES ARTIFI, V872, P229
[6]  
Decatur S. E., 1993, Proceeding of the Sixth Annual ACM Conference on Computational Learning Theory, P262, DOI 10.1145/168304.168346
[7]   PREDICTING (0,1)-FUNCTIONS ON RANDOMLY DRAWN POINTS [J].
HAUSSLER, D ;
LITTLESTONE, N ;
WARMUTH, MK .
INFORMATION AND COMPUTATION, 1994, 115 (02) :248-292
[8]   LEARNING INTEGER LATTICES [J].
HELMBOLD, D ;
SLOAN, R ;
WARMUTH, MK .
SIAM JOURNAL ON COMPUTING, 1992, 21 (02) :240-266
[9]  
HELMBOLD D, 1990, MACH LEARN, V5, P165, DOI 10.1023/A:1022696716689
[10]  
Kearns M., 1993, Proceedings of the Twenty-Fifth Annual ACM Symposium on the Theory of Computing, P392, DOI 10.1145/167088.167200