On the Learning Behavior of Adaptive Networks-Part II: Performance Analysis

被引:67
作者
Chen, Jianshu [1 ]
Sayed, Ali H. [1 ]
机构
[1] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Multi-agent learning; diffusion of information; steady-state performance; centralized solution; stochastic approximation; mean-square-error; LEAST-MEAN SQUARES; PARAMETER-ESTIMATION; DIFFUSION ADAPTATION; SUBGRADIENT METHODS; OPTIMIZATION; ALGORITHMS; STATIONARY; STRATEGIES;
D O I
10.1109/TIT.2015.2427352
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Part I of this paper examined the mean-square stability and convergence of the learning process of distributed strategies over graphs. The results identified conditions on the network topology, utilities, and data in order to ensure stability; the results also identified three distinct stages in the learning behavior of multiagent networks related to transient phases I and II and the steady-state phase. This Part II examines the steady-state phase of distributed learning by networked agents. Apart from characterizing the performance of the individual agents, it is shown that the network induces a useful equalization effect across all agents. In this way, the performance of noisier agents is enhanced to the same level as the performance of agents with less noisy data. It is further shown that in the small step-size regime, each agent in the network is able to achieve the same performance level as that of a centralized strategy corresponding to a fully connected network. The results in this part reveal explicitly which aspects of the network topology and operation influence performance and provide important insights into the design of effective mechanisms for the processing and diffusion of information over networks.
引用
收藏
页码:3518 / 3548
页数:31
相关论文
共 50 条
[41]   Physics-Inspired Neural Networks for Parameter Learning of Adaptive Cruise Control Systems [J].
Apostolakis, Theocharis ;
Ampountolas, Konstantinos .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (10) :14291-14301
[42]   Online Learning for Adaptive Video Streaming in Mobile Networks [J].
Karagkioules, Theodoros ;
Paschos, Georgios S. ;
Liakopoulos, Nikolaos ;
Fiandrotti, Attilio ;
Tsilimantos, Dimitrios ;
Cagnazzo, Marco .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (01)
[43]   Adaptive Robust Distributed Learning in Diffusion Sensor Networks [J].
Chouvardas, Symeon ;
Slavakis, Konstantinos ;
Theodoridis, Sergios .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (10) :4692-4707
[44]   PERFORMANCE IMPROVEMENT USING ADAPTIVE LEARNING ITINERARIES [J].
Marquez Vazquez, Jose Manuel ;
Gonzalez-Abril, Luis ;
Velasco-Morente, Francisco ;
Ortega Ramirez, Juan Antonio .
COMPUTATIONAL INTELLIGENCE, 2012, 28 (02) :234-260
[45]   Analysis of Consensus Adaptive Filters Over Directed and Markovian Switching Networks [J].
Xie, Siyu ;
Wang, Le Yi .
2022 13TH ASIAN CONTROL CONFERENCE, ASCC, 2022, :2030-2035
[46]   VLC Turbulence Effects on the Performance of the Fish School Behavior Modeling Mobile Diffusion Adaptive Networks in Underwater Environments [J].
Abdavinejad, Hosein ;
Mostafapour, Ehsan ;
Ghobadi, Changiz ;
Nourinia, Javad ;
Pak, Amin Lotfzad .
WIRELESS PERSONAL COMMUNICATIONS, 2022, 124 (02) :1661-1676
[47]   VLC Turbulence Effects on the Performance of the Fish School Behavior Modeling Mobile Diffusion Adaptive Networks in Underwater Environments [J].
Hosein Abdavinejad ;
Ehsan Mostafapour ;
Changiz Ghobadi ;
Javad Nourinia ;
Amin Lotfzad Pak .
Wireless Personal Communications, 2022, 124 :1661-1676
[48]   Piezoresistive Cantilever Performance-Part II: Optimization [J].
Park, Sung-Jin ;
Doll, Joseph C. ;
Rastegar, Ali J. ;
Pruitt, Beth L. .
JOURNAL OF MICROELECTROMECHANICAL SYSTEMS, 2010, 19 (01) :149-161
[49]   Globally optimal synthesis of heat exchanger networks. Part II: Nonminimal networks [J].
Chang, Chenglin ;
Liao, Zuwei ;
Costa, Andre L. H. ;
Bagajewicz, Miguel J. .
AICHE JOURNAL, 2020, 66 (07)
[50]   PERFORMANCE LIMITS OF LMS-BASED ADAPTIVE NETWORKS [J].
Zhao, Xiaochuan ;
Sayed, Ali H. .
2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, :3768-3771