Local Tracking Control for Unknown Interconnected Systems via Neuro-Dynamic Programming

This paper develops a neuro-dynamic programming based local tracking control (LTC) scheme for unknown interconnected systems. By using the local input-output data and the desired states of coupling subsystems, a local neural network (NN) identifier is established to obtain the local input gain matrix online. By introducing a modified local cost function, the Hamilton-Jacobi-Bellman equation is solved by a local critic NN with asymptotically convergent weight vector, which is obtained by nested update law, and the LTC can be derived with the desired state aided augmented subsystem. The stability of the closed-loop system is shown by Lyapunov's direct method. The simulation on the parallel inverted pendulum system illustrates that the developed LTC scheme is effective.