H∞ control for discrete-time nonlinear Stochastic systems

In this paper we develop an H-infinity-type theory for a large class of discrete-nonlinear stochastic systems. In particular, we establish a bounded real lemma for this case. We introduce the notion of stochastic dissipative systems, analogously to the familiar notion of dissipation associated with deterministic systems, and utilize it in the derivation of the bounded real lemma. In particular, this bounded real lemma establishes necessary and sufficient conditions, in terms of a certain Hamilton Jacobi Inequality (HJI), for a discrete-time nonlinear stochastic system to be an l(2)-gain <= gamma. The time-invariant case is also considered, where in this case the bounded real lemma guarantees necessary and sufficient conditions for the system to be l(2)-gain <= gamma, by means of a solution to a certain algebraic HJI. Stability, in both the mean square sense and in probabilty, is discussed and a utilization of the Linear Matrix Inequalities (LMIs) technique is made to synthesize a controller that achieves an l(2)-gain property.