Poisson Reweighted Laplacian Uncertainty Sampling for Graph-Based Active Learning

被引:3
作者
Miller, Kevin [1 ]
Calder, Jeff [2 ]
机构
[1] Univ Texas Austin, Oden Inst Computat Engn & Sci, Austin, TX 78712 USA
[2] Univ Minnesota, Sch Math, Minneapolis, MN 55455 USA
来源
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE | 2023年 / 5卷 / 04期
关键词
active learning; uncertainty sampling; graph Laplacian; continuum limit; partial differential equations; P-LAPLACIAN; REGULARIZATION; CONVERGENCE; EIGENMAPS;
D O I
10.1137/22M1531981
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show that uncertainty sampling is sufficient to achieve exploration versus exploitation in graph-based active learning, as long as the measure of uncertainty properly aligns with the underlying model and the model properly reflects uncertainty in unexplored regions. In particular, we use a recently developed algorithm, Poisson ReWeighted Laplace Learning (PWLL), for the classifier and we introduce an acquisition function designed to measure uncertainty in this graph-based classifier that identifies unexplored regions of the data. We introduce a diagonal perturbation in PWLL which produces exponential localization of solutions, and controls the exploration versus exploitation tradeoff in active learning. We use the well-posed continuum limit of PWLL to rigorously analyze our method and present experimental results on a number of graph-based image classification problems.
引用
收藏
页码:1160 / 1190
页数:31
相关论文
共 77 条
[21]  
Dasarathy G., 2015, C LEARN THEOR, P503
[22]  
Dasgupta S, 2008, P 25 INT C MACH LEAR, P208, DOI DOI 10.1145/1390156.1390183
[23]  
Dasgupta S., 2006, P INT C ADV NEUR INF, P235
[24]   Two faces of active learning [J].
Dasgupta, Sanjoy .
THEORETICAL COMPUTER SCIENCE, 2011, 412 (19) :1767-1781
[25]   Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data [J].
Donoho, DL ;
Grimes, C .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2003, 100 (10) :5591-5596
[26]   Large data and zero noise limits of graph-based semi-supervised learning algorithms [J].
Dunlop, Matthew M. ;
Slepcev, Dejan ;
Stuart, Andrew M. ;
Thorpe, Matthew .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2020, 49 (02) :655-697
[27]  
El Alaoui A., 2016, C LEARNING THEORY, P879
[28]   Analysis and algorithms for lp-based semi-supervised learning on graphs [J].
Flores, Mauricio ;
Calder, Jeff ;
Lerman, Gilad .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2022, 60 :77-122
[29]  
Gao L, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2142
[30]   Error Estimates for Spectral Convergence of the Graph Laplacian on Random Geometric Graphs Toward the Laplace-Beltrami Operator [J].
Garcia Trillos, Nicolas ;
Gerlach, Moritz ;
Hein, Matthias ;
Slepcev, Dejan .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2020, 20 (04) :827-887