Poisson Reweighted Laplacian Uncertainty Sampling for Graph-Based Active Learning

被引:3
作者
Miller, Kevin [1 ]
Calder, Jeff [2 ]
机构
[1] Univ Texas Austin, Oden Inst Computat Engn & Sci, Austin, TX 78712 USA
[2] Univ Minnesota, Sch Math, Minneapolis, MN 55455 USA
来源
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE | 2023年 / 5卷 / 04期
关键词
active learning; uncertainty sampling; graph Laplacian; continuum limit; partial differential equations; P-LAPLACIAN; REGULARIZATION; CONVERGENCE; EIGENMAPS;
D O I
10.1137/22M1531981
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show that uncertainty sampling is sufficient to achieve exploration versus exploitation in graph-based active learning, as long as the measure of uncertainty properly aligns with the underlying model and the model properly reflects uncertainty in unexplored regions. In particular, we use a recently developed algorithm, Poisson ReWeighted Laplace Learning (PWLL), for the classifier and we introduce an acquisition function designed to measure uncertainty in this graph-based classifier that identifies unexplored regions of the data. We introduce a diagonal perturbation in PWLL which produces exponential localization of solutions, and controls the exploration versus exploitation tradeoff in active learning. We use the well-posed continuum limit of PWLL to rigorously analyze our method and present experimental results on a number of graph-based image classification problems.
引用
收藏
页码:1160 / 1190
页数:31
相关论文
共 77 条
[11]  
Calder J., 2022, GRAPH BASED SEMISUPE
[12]   Rates of convergence for Laplacian semi-supervised learning with low labeling rates [J].
Calder, Jeff ;
Slepcev, Dejan ;
Thorpe, Matthew .
RESEARCH IN THE MATHEMATICAL SCIENCES, 2023, 10 (01)
[13]   Improved spectral convergence rates for graph Laplacians on ε-graphs and k-NN graphs [J].
Calder, Jeff ;
Trillos, Nicolas Garcia .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2022, 60 :123-175
[14]  
Calder J, 2020, PR MACH LEARN RES, V119
[15]   Properly-Weighted Graph Laplacian for Semi-supervised Learning [J].
Calder, Jeff ;
Slepcev, Dejan .
APPLIED MATHEMATICS AND OPTIMIZATION, 2020, 82 (03) :1111-1159
[16]   Consistency of Lipschitz Learning with Infinite Unlabeled Data and Finite Labeled Data [J].
Calder, Jeff .
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2019, 1 (04) :780-812
[17]   The game theoretic p-Laplacian and semi-supervised learning with few labels [J].
Calder, Jeff .
NONLINEARITY, 2019, 32 (01) :301-330
[18]   Cautious active clustering [J].
Cloninger, A. ;
Mhaskar, H. N. .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2021, 54 :44-74
[19]  
Cohen G., 2017, PREPRINT
[20]   Diffusion maps [J].
Coifman, Ronald R. ;
Lafon, Stephane .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2006, 21 (01) :5-30