A New Recurrent Neural Network for Solving Convex Quadratic Programming Problems With an Application to the k-Winners-Take-All Problem

被引:53
作者
Hu, Xiaolin [1 ,2 ]
Zhang, Bo [1 ,2 ]
机构
[1] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, TNList, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2009年 / 20卷 / 04期
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Asymptotic stability; k-winners-take-all (k-WTA); linear programming; neural network; quadratic programming; LINEAR VARIATIONAL-INEQUALITIES; OPTIMIZATION PROBLEMS; O(N) COMPLEXITY; CONSTRAINTS; CIRCUIT; CONVERGENCE; EQUATIONS; DESIGN; KWTA;
D O I
10.1109/TNN.2008.2011266
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a new recurrent neural network is proposed for solving convex quadratic programming (QP) problems. Compared with existing neural networks, the proposed one features global convergence property under weak conditions, low structural complexity, and no calculation of matrix inverse. It serves as a competitive alternative in the neural network family for solving linear or quadratic programming problems. In addition, it is found that by some variable substitution, the proposed network turns out to be an existing model for solving minimax problems. In this sense, it can be also viewed as a special case of the minimax neural network. Based on this scheme, a k-winners-take-all (k-WTA) network with O (n) complexity is designed, which is characterized by simple structure, global convergence, and capability to deal with some ill cases. Numerical simulations are provided to validate the theoretical results obtained. More importantly, the network design method proposed in this paper has great potential to inspire other competitive inventions along the same line.
引用
收藏
页码:654 / 664
页数:11
相关论文
共 43 条
[1]  
Bazaraa M. S., 1993, NONLINEAR PROGRAM MI
[2]   Another K-winners-take-all analog neural network [J].
Calvert, BD ;
Marinov, CA .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :829-838
[3]  
Chua LO., 1987, Linear and nonlinear circuits
[4]   Generalized neural network, for nonsmooth nonlinear programming problems [J].
Forti, M ;
Nistri, P ;
Quincampoix, M .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2004, 51 (09) :1741-1754
[5]   A novel neural network for variational inequalities with linear and nonlinear constraints [J].
Gao, XB ;
Liao, LZ ;
Qi, LQ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (06) :1305-1317
[6]   A novel neural network for nonlinear convex programming [J].
Gao, XB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (03) :613-621
[7]   A neural network for monotone variational inequalities with linear constraints [J].
Gao, XB ;
Liao, LZ .
PHYSICS LETTERS A, 2003, 307 (2-3) :118-128
[8]   A novel neural network for a class of convex quadratic minimax problems [J].
Gao, Xing-Bao ;
Liao, Li-Zhi .
NEURAL COMPUTATION, 2006, 18 (08) :1818-1846
[9]   An efficient simplified neural network for solving linear and quadratic programming problems [J].
Ghasabi-Oskoei, Hasan ;
Mahdavi-Amiri, Nezam .
APPLIED MATHEMATICS AND COMPUTATION, 2006, 175 (01) :452-464
[10]   COMPUTING WITH NEURAL CIRCUITS - A MODEL [J].
HOPFIELD, JJ ;
TANK, DW .
SCIENCE, 1986, 233 (4764) :625-633