Two-timescale recurrent neural networks for distributed minimax optimization

被引:12
作者
Xia, Zicong [1 ]
Liu, Yang [1 ,2 ]
Wang, Jiasen [3 ]
Wang, Jun [4 ,5 ]
机构
[1] Zhejiang Normal Univ, Sch Math Sci, Jinhua 321004, Peoples R China
[2] Zhejiang Normal Univ, Key Lab Intelligent Educ Technol & Applicat Zhejia, Jinhua 321004, Peoples R China
[3] Future Network Res Ctr, Purple Mt Labs, Nanjing 211111, Peoples R China
[4] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[5] City Univ Hong Kong, Sch Data Sci, Hong Kong, Peoples R China
关键词
Neurodynamic optimization; Distributed optimization; Minimax optimization; Recurrent neural networks; NEURODYNAMIC APPROACH; CONVEX-OPTIMIZATION; SUBJECT;
D O I
10.1016/j.neunet.2023.06.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present two-timescale neurodynamic optimization approaches to distributed min-imax optimization. We propose four multilayer recurrent neural networks for solving four different types of generally nonlinear convex-concave minimax problems subject to linear equality and nonlin-ear inequality constraints. We derive sufficient conditions to guarantee the stability and optimality of the neural networks. We demonstrate the viability and efficiency of the proposed neural networks in two specific paradigms for Nash-equilibrium seeking in a zero-sum game and distributed constrained nonlinear optimization.& COPY; 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:527 / 539
页数:13
相关论文
共 54 条
[1]   BEST RESPONSE DYNAMICS FOR CONTINUOUS GAMES [J].
Barron, E. N. ;
Goebel, R. ;
Jensen, R. R. .
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY, 2010, 138 (03) :1069-1083
[2]  
Bazaraa Mokhtar S, 2013, Nonlinear Programming: Theory and Algorithms
[3]  
Bertsekas D.P., 2009, Convex Optimization Theory
[4]  
Boggs P. T., 1995, ACTA NUMER, V4, P1, DOI [10.1017/S0962492900002518, DOI 10.1017/S0962492900002518]
[5]   A Two-Timescale Duplex Neurodynamic Approach to Mixed-Integer Optimization [J].
Che, Hangjun ;
Wang, Jun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) :36-48
[6]   A collaborative neurodynamic approach to global and combinatorial optimization [J].
Che, Hangjun ;
Wang, Jun .
NEURAL NETWORKS, 2019, 114 :15-27
[7]   A Two-Timescale Duplex Neurodynamic Approach to Biconvex Optimization [J].
Che, Hangjun ;
Wang, Jun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (08) :2503-2514
[8]  
Cortés J, 2008, IEEE CONTR SYST MAG, V28, P36, DOI 10.1109/MCS.2008.919306
[9]  
Ga XB, 2004, IEEE T NEURAL NETWOR, V15, P622, DOI 10.1109/TNN.2004.824405
[10]   Novel Continuous-and Discrete-Time Neural Networks for Solving Quadratic Minimax Problems With Linear Equality Constraints [J].
Gao, Xingbao ;
Liao, Li-Zhi .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) :9814-9828