Poisson Reweighted Laplacian Uncertainty Sampling for Graph-Based Active Learning

被引:3
作者
Miller, Kevin [1 ]
Calder, Jeff [2 ]
机构
[1] Univ Texas Austin, Oden Inst Computat Engn & Sci, Austin, TX 78712 USA
[2] Univ Minnesota, Sch Math, Minneapolis, MN 55455 USA
来源
SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE | 2023年 / 5卷 / 04期
关键词
active learning; uncertainty sampling; graph Laplacian; continuum limit; partial differential equations; P-LAPLACIAN; REGULARIZATION; CONVERGENCE; EIGENMAPS;
D O I
10.1137/22M1531981
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We show that uncertainty sampling is sufficient to achieve exploration versus exploitation in graph-based active learning, as long as the measure of uncertainty properly aligns with the underlying model and the model properly reflects uncertainty in unexplored regions. In particular, we use a recently developed algorithm, Poisson ReWeighted Laplace Learning (PWLL), for the classifier and we introduce an acquisition function designed to measure uncertainty in this graph-based classifier that identifies unexplored regions of the data. We introduce a diagonal perturbation in PWLL which produces exponential localization of solutions, and controls the exploration versus exploitation tradeoff in active learning. We use the well-posed continuum limit of PWLL to rigorously analyze our method and present experimental results on a number of graph-based image classification problems.
引用
收藏
页码:1160 / 1190
页数:31
相关论文
共 77 条
[1]  
[Anonymous], 2006, Semi-Supervised Learning
[2]  
[Anonymous], 2017, P 34 INT C MACH LEAR
[3]   Margin based active learning [J].
Balcan, Maria-Florina ;
Broder, Andrei ;
Zhang, Tong .
LEARNING THEORY, PROCEEDINGS, 2007, 4539 :35-+
[4]   Agnostic active learning [J].
Balcan, Maria-Florina ;
Beygelzimer, Alina ;
Langford, John .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2009, 75 (01) :78-89
[5]   Regularization and semi-supervised learning on large graphs [J].
Belkin, M ;
Matveeva, I ;
Niyogi, P .
LEARNING THEORY, PROCEEDINGS, 2004, 3120 :624-638
[6]   Semi-supervised learning on Riemannian manifolds [J].
Belkin, M ;
Niyogi, P .
MACHINE LEARNING, 2004, 56 (1-3) :209-239
[7]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[8]  
Bertozzi AL, 2019, HANDB NUM ANAL, V20, P503, DOI 10.1016/bs.hna.2019.04.001
[9]   Diffuse Interface Models on Graphs for Classification of High Dimensional Data [J].
Bertozzi, Andrea L. ;
Flenner, Arjuna .
SIAM REVIEW, 2016, 58 (02) :293-328
[10]  
Cai H, 2017, PREPRINT