Constrained Quaternion-Variable Convex Optimization: A Quaternion-Valued Recurrent Neural Network Approach

被引:95
作者
Liu, Yang [1 ]
Zheng, Yanling [1 ]
Lu, Jianquan [2 ]
Cao, Jinde [2 ,3 ,4 ]
Rutkowski, Leszek [5 ,6 ]
机构
[1] Zhejiang Normal Univ, Coll Math & Comp Sci, Jinhua 321004, Zhejiang, Peoples R China
[2] Southeast Univ, Sch Math, Jiangsu Prov Key Lab Networked Collect Intelligen, Nanjing 210096, Peoples R China
[3] Nantong Univ, Sch Elect Engn, Nantong 226000, Peoples R China
[4] Shandong Normal Univ, Sch Math Sci, Jinan 250014, Peoples R China
[5] Czestochowa Tech Univ, Inst Computat Intelligence, PL-42200 Czestochowa, Poland
[6] Univ Social Sci, Informat Technol Inst, PL-90113 Lodz, Poland
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Quaternions; Optimization; Convex functions; Recurrent neural networks; Calculus; Biological neural networks; Collective intelligence; Constrained convex optimization; generalized gradient inclusion; generalized Hamilton-real (GHR) calculus; Lyapunov function; SINGULAR SPECTRUM ANALYSIS; FINITE-TIME CONSENSUS; MULTIAGENT SYSTEMS; GRADIENT OPERATOR; COMPLEX MATRIX;
D O I
10.1109/TNNLS.2019.2916597
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a quaternion-valued one-layer recurrent neural network approach to resolve constrained convex function optimization problems with quaternion variables. Leveraging the novel generalized Hamilton-real (GHR) calculus, the quaternion gradient-based optimization techniques are proposed to derive the optimization algorithms in the quaternion field directly rather than the methods of decomposing the optimization problems into the complex domain or the real domain. Via chain rules and Lyapunov theorem, the rigorous analysis shows that the deliberately designed quaternion-valued one-layer recurrent neural network stabilizes the system dynamics while the states reach the feasible region in finite time and converges to the optimal solution of the considered constrained convex optimization problems finally. Numerical simulations verify the theoretical results.
引用
收藏
页码:1022 / 1035
页数:14
相关论文
共 50 条
  • [21] A one-layer recurrent neural network with a discontinuous hard-limiting activation function for quadratic programming
    Liu, Qingshan
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (04): : 558 - 570
  • [22] A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization
    Liu, Qingshan
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2011, 41 (05): : 1323 - 1333
  • [23] A Recurrent Neural Network Based on Projection Operator for Extended General Variational Inequalities
    Liu, Qingshan
    Cao, Jinde
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2010, 40 (03): : 928 - 938
  • [24] Finite-Time Consensus of Multiagent Systems With a Switching Protocol
    Liu, Xiaoyang
    Lam, James
    Yu, Wenwu
    Chen, Guanrong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (04) : 853 - 862
  • [25] Stability Analysis of Quaternion-Valued Neural Networks: Decomposition and Direct Approaches
    Liu, Yang
    Zhang, Dandan
    Lou, Jungang
    Lu, Jianquan
    Cao, Jinde
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (09) : 4201 - 4211
  • [26] Global exponential stability for quaternion-valued recurrent neural networks with time-varying delays
    Liu, Yang
    Zhang, Dandan
    Lu, Jianquan
    [J]. NONLINEAR DYNAMICS, 2017, 87 (01) : 553 - 565
  • [27] Global μ-stability criteria for quaternion-valued neural networks with unbounded time-varying delays
    Liu, Yang
    Zhang, Dandan
    Lu, Jianquan
    Cao, Jinde
    [J]. INFORMATION SCIENCES, 2016, 360 : 273 - 288
  • [28] Lopez CM, 2012, IEEE SYS MAN CYBERN, P2849, DOI 10.1109/ICSMC.2012.6378181
  • [29] Luo LC, 2010, P 2010 INT C MULT TE
  • [30] A Quaternion Gradient Operator and Its Applications
    Mandic, D. P.
    Jahanchahi, C.
    Took, C. Cheong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2011, 18 (01) : 47 - 50