Adaptive Graph Filters in Reproducing Kernel Hilbert Spaces: Design and Performance Analysis

被引:28
作者
Elias, Vitor R. M. [1 ,2 ]
Gogineni, Vinay Chakravarthi [3 ]
Martins, Wallace A. [2 ,4 ]
Werner, Stefan [1 ]
机构
[1] Norwegian Univ Sci & Technol, N-7491 Trondheim, Norway
[2] Univ Fed Rio de Janeiro, BR-21941901 Rio De Janeiro, RJ, Brazil
[3] Simula Res Lab, Machine Intelligence Dept, SimulaMet, Oslo, Norway
[4] Univ Luxembourg, Interdisciplinary Ctr Secur Reliabil & Trust SnT, Luxembourg, Luxembourg
来源
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS | 2021年 / 7卷
关键词
Adaptive signal processing; distributed learning; kernel LMS; kernel graph filters; random fourier features;
D O I
10.1109/TSIPN.2020.3046217
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper develops adaptive graph filters that operate in reproducing kernel Hilbert spaces. We consider both centralized and fully distributed implementations. We first define nonlinear graph filters that operate on graph-shifted versions of the input signal. We then propose a centralized graph kernel least mean squares (GKLMS) algorithm to identify nonlinear graph filters' model parameters. To reduce the dictionary size of the centralized GKLMS, we apply the principles of coherence check and random Fourier features (RFF). The resulting algorithms have performance close to that of the GKLMS algorithm. Additionally, we leverage the graph structure to derive the distributed graph diffusion KLMS (GDKLMS) algorithms. We show that, unlike the coherence check-based approach, the GDKLMS based on RFF avoids the use of a pre-trained dictionary through its data-independent fixed structure. We conduct a detailed performance study of the proposed RFF-based GDKLMS, and the conditions for its convergence both in mean and mean-squared senses are derived. Extensive numerical simulations show that GKLMS and GDKLMS can successfully identify nonlinear graph filters and adapt to model changes. Furthermore, RFF-based strategies show faster convergence for model identification and exhibit better tracking performance in model-changing scenarios.
引用
收藏
页码:62 / 74
页数:13
相关论文
共 68 条
[1]  
[Anonymous], 2019, INTEL LABDATA
[2]   THEORY OF REPRODUCING KERNELS [J].
ARONSZAJN, N .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1950, 68 (MAY) :337-404
[3]  
Bouboulis P., 2016, PROC IEEE STAT SIGNA, P1
[4]   Online Distributed Learning Over Networks in RKH Spaces Using Random Fourier Features [J].
Bouboulis, Pantelis ;
Chouvardas, Symeon ;
Theodoridis, Sergios .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (07) :1920-1932
[5]   Graph Signal Processing in the Presence of Topology Uncertainties [J].
Ceci, Elena ;
Barbarossa, Sergio .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :1558-1573
[6]   Nonlinear Adaptive Filtering With Kernel Set-Membership Approach [J].
Chen, Kewei ;
Werner, Stefan ;
Kuh, Anthony ;
Huang, Yih-Fang .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :1515-1528
[7]   Discrete Signal Processing on Graphs: Sampling Theory [J].
Chen, Siheng ;
Varma, Rohan ;
Sandryhaila, Aliaksei ;
Kovacevic, Jelena .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (24) :6510-6523
[8]  
Chouvardas S, 2016, INT CONF ACOUST SPEE, P4164, DOI 10.1109/ICASSP.2016.7472461
[9]  
Comminiello D., 2018, ADAPTIVE LEARNING ME
[10]   Distributed Adaptive Learning of Graph Signals [J].
Di Lorenzo, Paolo ;
Banelli, Paolo ;
Barbarossa, Sergio ;
Sardellitti, Stefania .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (16) :4193-4208