Constrained Quaternion-Variable Convex Optimization: A Quaternion-Valued Recurrent Neural Network Approach

被引:95
作者
Liu, Yang [1 ]
Zheng, Yanling [1 ]
Lu, Jianquan [2 ]
Cao, Jinde [2 ,3 ,4 ]
Rutkowski, Leszek [5 ,6 ]
机构
[1] Zhejiang Normal Univ, Coll Math & Comp Sci, Jinhua 321004, Zhejiang, Peoples R China
[2] Southeast Univ, Sch Math, Jiangsu Prov Key Lab Networked Collect Intelligen, Nanjing 210096, Peoples R China
[3] Nantong Univ, Sch Elect Engn, Nantong 226000, Peoples R China
[4] Shandong Normal Univ, Sch Math Sci, Jinan 250014, Peoples R China
[5] Czestochowa Tech Univ, Inst Computat Intelligence, PL-42200 Czestochowa, Poland
[6] Univ Social Sci, Informat Technol Inst, PL-90113 Lodz, Poland
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Quaternions; Optimization; Convex functions; Recurrent neural networks; Calculus; Biological neural networks; Collective intelligence; Constrained convex optimization; generalized gradient inclusion; generalized Hamilton-real (GHR) calculus; Lyapunov function; SINGULAR SPECTRUM ANALYSIS; FINITE-TIME CONSENSUS; MULTIAGENT SYSTEMS; GRADIENT OPERATOR; COMPLEX MATRIX;
D O I
10.1109/TNNLS.2019.2916597
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a quaternion-valued one-layer recurrent neural network approach to resolve constrained convex function optimization problems with quaternion variables. Leveraging the novel generalized Hamilton-real (GHR) calculus, the quaternion gradient-based optimization techniques are proposed to derive the optimization algorithms in the quaternion field directly rather than the methods of decomposing the optimization problems into the complex domain or the real domain. Via chain rules and Lyapunov theorem, the rigorous analysis shows that the deliberately designed quaternion-valued one-layer recurrent neural network stabilizes the system dynamics while the states reach the feasible region in finite time and converges to the optimal solution of the considered constrained convex optimization problems finally. Numerical simulations verify the theoretical results.
引用
收藏
页码:1022 / 1035
页数:14
相关论文
共 50 条
  • [1] [Anonymous], 1995, J MATH STUDY
  • [2] Biggs J., 2015, P IMA C MATH ROB, P1
  • [3] BRANDWOOD DH, 1983, IEE PROC-H, V130, P11
  • [4] State Estimation for Quaternion-Valued Neural Networks With Multiple Time Delays
    Chen, Xiaofeng
    Song, Qiankun
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (11): : 2278 - 2287
  • [5] Design and Analysis of Quaternion-Valued Neural Networks for Associative Memories
    Chen, Xiaofeng
    Song, Qiankun
    Li, Zhongshan
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (12): : 2305 - 2314
  • [6] Stability Analysis of Continuous-Time and Discrete-Time Quaternion-Valued Neural Networks With Linear Threshold Neurons
    Chen, Xiaofeng
    Song, Qiankun
    Li, Zhongshan
    Zhao, Zhenjiang
    Liu, Yurong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (07) : 2769 - 2781
  • [7] Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks
    Cheng, Long
    Hou, Zeng-Guang
    Lin, Yingzi
    Tan, Min
    Zhang, Wenjun Chris
    Wu, Fang-Xiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (05): : 714 - 726
  • [8] Clarkewrited F., 1983, OPTIMIZATION NONSMOO
  • [9] Uncertainty analysis of effective elasticity tensors using quaternion-based global optimization and Monte-Carlo method
    Danek, T.
    Kochetov, M.
    Slawinski, M. A.
    [J]. QUARTERLY JOURNAL OF MECHANICS AND APPLIED MATHEMATICS, 2013, 66 (02) : 253 - 272
  • [10] QUATERNION CALCULUS
    DEAVOURS, CA
    [J]. AMERICAN MATHEMATICAL MONTHLY, 1973, 80 (09) : 995 - 1008