Adaptive clustering based on element-wised distance for distributed estimation over multi-task networks

被引:1
作者
Zhang, A. Yuanyuan [1 ,3 ,4 ]
Feng, B. Minyu [1 ]
Chen, C. Feng [1 ,3 ,5 ]
Kurths, D. Juergen [2 ,6 ]
机构
[1] Southwest Univ, Coll Artificial Intelligence, Chongqing 400715, Peoples R China
[2] Potsdam Inst Climate Impact Res, D-14473 Potsdam, Germany
[3] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[4] Key Lab Nonlinear Circuits & Intelligent Informat, Chongqing, Peoples R China
[5] Southwest Univ, Brain Inspired Comp & Intelligent Control Key Lab, Chongqing 400715, Peoples R China
[6] Humboldt Univ, Dept Phys, D-12489 Berlin, Germany
基金
国家重点研发计划;
关键词
DIFFUSION LMS ALGORITHM; SENSOR NETWORKS; CONSENSUS; OPTIMIZATION; ADAPTATION; STRATEGIES; SQUARES;
D O I
10.1063/1.5141493
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In multitask networks, neighboring agents that belong to different clusters pursue different goals, and therefore arbitrary cooperation will lead to a degradation in estimation performance. In this paper, an adaptive clustering method is proposed for distributed estimation that enables agents to distinguish between subneighbors that belong to the same cluster and those that belong to a different cluster. This creates an appropriate degree of cooperation to improve parameter estimation accuracy, especially for the case where the prior information of a cluster is unknown. In contrast to the static and quantitative threshold that is imposed in traditional clustering methods, we devise a method for real-time clustering hypothesis detection, which is constructed through the use of a reliable adaptive clustering threshold as reference and the averaged element-wise distance between tasks as real-time clustering detection statistic. Meanwhile, we relax the clustering conditions to maintain maximum cooperation without sacrificing accuracy. Simulations are presented to compare the proposed algorithm and some traditional clustering strategies in both stationary and nonstationary environments. The effects of task difference on performance are also obtained to demonstrate the superiority of our proposed clustering strategy in terms of accuracy, robustness, and suitability.
引用
收藏
页数:10
相关论文
共 28 条
[1]   A new class of incremental gradient methods for least squares problems [J].
Bertsekas, DP .
SIAM JOURNAL ON OPTIMIZATION, 1997, 7 (04) :913-926
[2]   Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses [J].
Braca, Paolo ;
Marano, Stefano ;
Matta, Vincenzo ;
Willett, Peter .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (02) :814-825
[3]   Diffusion LMS Strategies for Distributed Estimation [J].
Cattivelli, Federico S. ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (03) :1035-1048
[4]  
Chen B., 2019, ARXIV190406617
[5]   Diffusion generalized maximum correntropy criterion algorithm for distributed estimation over multitask network [J].
Chen, Feng ;
Li, Xinyu ;
Duan, Shukai ;
Wang, Lidan ;
Wu, Jiagui .
DIGITAL SIGNAL PROCESSING, 2018, 81 :16-25
[6]   Broken-motifs diffusion LMS algorithm for reducing communication load [J].
Chen, Feng ;
Shao, Xiaodan .
SIGNAL PROCESSING, 2017, 133 :213-218
[7]   Distributed Pareto Optimization via Diffusion Strategies [J].
Chen, Jianshu ;
Sayed, Ali H. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2013, 7 (02) :205-220
[8]   Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks [J].
Chen, Jianshu ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (08) :4289-4305
[9]   Diffusion LMS Over Multitask Networks [J].
Chen, Jie ;
Richard, Cedric ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (11) :2733-2748
[10]   Multitask Diffusion Adaptation Over Networks [J].
Chen, Jie ;
Richard, Cedric ;
Sayed, Ali H. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (16) :4129-4144