CONTROLLABILITY OF STOCHASTIC GAME-BASED CONTROL SYSTEMS

被引:35
作者
Zhang, Renren [1 ]
Guo, Lei [1 ]
机构
[1] Chinese Acad Sci, AMSS, Inst Syst Sci, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
noncooperative stochastic differential games; hierarchical structure; game-based control systems; Nash equilibrium; controllability; forward-backward stochastic differential equations; DIFFERENTIAL GAME; STABILIZATION-POLICIES; OPEN-LOOP;
D O I
10.1137/18M120854X
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is well known that in classical control theory, the controller has a certain objective to achieve, and the plant to be controlled does not have its own objective. However, this is not the case in many practical situations in, for example, social, economic, and rapidly developing "intelligent" engineering systems. For these kinds of systems, the classical control theory cannot be applied directly. This motivates us to introduce a new control framework called game-based control systems (GBCSs), which has a hierarchical decision-making structure, i.e., a higher level regulator and lower level multiple agents. The regulator is regarded as the macrocontroller that makes decisions first, and then the agents try to optimize their respective objective functions, where a possible Nash equilibrium may be reached as a result of a noncooperative differential game. A fundamental issue in GBCSs is whether it is possible for the regulator to change the macrostates of the system by regulating the Nash equilibrium formed by the agents at the lower level. The investigation of this problem was initiated recently by the authors for deterministic systems. In this paper, we formulate this problem in the general stochastic nonlinear framework, and then focus on linear stochastic systems to give some explicit necessary and sufficient algebraic conditions on the controllability of the Nash equilibrium. In contrast to the classical controllability theory on forward differential equations, we now need to investigate the controllability of the associated forward-backward stochastic differential equations, which involves a more complicated investigation. Moreover, in the current stochastic case, which is more complicated than the deterministic case, we need some deep understanding of forward-backward stochastic differential equations.
引用
收藏
页码:3799 / 3826
页数:28
相关论文
共 48 条
[1]  
Alizadeh Yahgoub, 2013, 2013 5th International Conference on Computational Intelligence and Communication Networks (CICN), P105, DOI 10.1109/CICN.2013.33
[2]  
[Anonymous], 1999, Forward-backward stochastic differential equations and their applications
[3]  
[Anonymous], 2015, GAME THEORY DISTRIBU
[4]  
[Anonymous], 2006, Cooperative stochastic differential games
[5]  
[Anonymous], 2000, DIFFERENTIAL GAMES E
[6]  
[Anonymous], 2010, Network Security: A Decision and Game-Theoretic Approach
[7]  
Basar T., 1998, DYNAMIC NONCOOPERATI, V2nd, DOI [10.1137/1.9781611971132, DOI 10.1137/1.9781611971132]
[8]   Noncooperative Differential Games [J].
Bressan, Alberto .
MILAN JOURNAL OF MATHEMATICS, 2011, 79 (02) :357-427
[9]   STOCHASTIC STACKELBERG GAMES - NONNESTED MULTISTAGE MULTIAGENT INCENTIVE PROBLEMS [J].
CHANG, TS ;
HO, YC .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1983, 28 (04) :477-488
[10]   Quantitative Genetics of the Aging of Reproductive Traits in the Houbara Bustard [J].
Chantepie, Stephane ;
Robert, Alexandre ;
Sorci, Gabriele ;
Hingrat, Yves ;
Charmantier, Anne ;
Leveque, Gwenaelle ;
Lacroix, Frederic ;
Teplitsky, Celine .
PLOS ONE, 2015, 10 (07)