Active Learning in Black-Box Settings

被引:0
|
作者
Rubens, Neil [1 ]
Sheinman, Vera [2 ]
Tomioka, Ryota [3 ]
Sugiyama, Masashi [4 ]
机构
[1] Univ Electrocommun, Dept Informat Syst, 1-5-1 Chofugaoka, Chofu, Tokyo 1828585, Japan
[2] Japanese Inst Educ Measurement, Minato Ku, Tokyo 1070061, Japan
[3] Univ Tokyo, Grad Sch Informat Sci & Technol, Bunkyo Ku, Tokyo 1138656, Japan
[4] Tokyo Inst Technol, Grad Sch Informat Sci & Engn, Meguro Ku, Tokyo 1528552, Japan
关键词
Active Learning; Sampling; Experiment Design; Black Box Settings; Model Independent; Output Estimates;
D O I
暂无
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Active learning refers to the settings in which a machine learning algorithm (learner) is able to select data from which it learns (selecting points and then obtaining their labels), and by doing so aims to achieve better accuracy (e.g., by avoiding obtaining training data that is redundant or unimportant). Active learning is particularly useful in cases where the labeling cost is high. A common assumption is that an active learning algorithm is aware of the details of the underlying learning algorithm for which it obtains the data. However, in many practical settings, obtaining precise details of the learning algorithm may not be feasible, making the underlying algorithm in essence a black box - no knowledge of the internal workings of the algorithm is available, and only the inputs and corresponding output estimates are accessible. This makes many of the traditional approaches not applicable, or at the least not effective. Hence our motivation is to use the only data that is accessible in black box settings - output estimates. We note that accuracy will improve only if the learner's output estimates change. Therefore we propose active learning criterion that utilizes the information contained within the changes of output estimates.
引用
收藏
页码:125 / 135
页数:11
相关论文
共 50 条