Bias-Variance Tradeoff of Graph Laplacian Regularizer

被引:13
作者
Chen, Pin-Yu [1 ]
Liu, Sijia [2 ]
机构
[1] IBM Thomas J Watson Res Ctr, AI Foudat, Yorktown Hts, NY 10598 USA
[2] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
关键词
Graph signal processing; mean squared error (MSE) analysis; scaling law; spectral graph theory;
D O I
10.1109/LSP.2017.2712141
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This letter presents a bias-variance tradeoff of graph Laplacian regularizer, which is widely used in graph signal processing and semisupervised learning tasks. The scaling law of the optimal regularization parameter is specified in terms of the spectral graph properties and a novel signal-to-noise ratio parameter, which suggests that selecting a mediocre regularization parameter is often suboptimal. The analysis is applied to three applications, including random, band-limited, and multiple-sampled graph signals. Experiments on synthetic and real-world graphs demonstrate near-optimal performance of the established analysis.
引用
收藏
页码:1118 / 1122
页数:5
相关论文
共 25 条
[1]   Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies [J].
Anis, Aamir ;
Gadde, Akshay ;
Ortega, Antonio .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (14) :3775-3789
[2]  
[Anonymous], 1985, Matrix Analysis
[3]   Regularization and semi-supervised learning on large graphs [J].
Belkin, M ;
Matveeva, I ;
Niyogi, P .
LEARNING THEORY, PROCEEDINGS, 2004, 3120 :624-638
[4]   Semi-supervised learning on Riemannian manifolds [J].
Belkin, M ;
Niyogi, P .
MACHINE LEARNING, 2004, 56 (1-3) :209-239
[5]  
Belkin M, 2006, J MACH LEARN RES, V7, P2399
[6]   Seeing the Bigger Picture [J].
Bertrand, Alexander ;
Moonen, Marc .
IEEE SIGNAL PROCESSING MAGAZINE, 2013, 30 (03) :71-82
[7]  
Chen P.-Y., 2017, ICASSP
[8]   Deep Community Detection [J].
Chen, Pin-Yu ;
Hero, Alfred O., III .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (21) :5706-5719
[9]   Phase Transitions in Spectral Community Detection [J].
Chen, Pin-Yu ;
Hero, Alfred O., III .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (16) :4339-4347
[10]   Signal Recovery on Graphs: Fundamental Limits of Sampling Strategies [J].
Chen, Siheng ;
Varma, Rohan ;
Singh, Aarti ;
Kovacevic, Jelena .
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2016, 2 (04) :539-554