Sufficient and Necessary Open-Loop Stackelberg Strategy for Two-Player Game With Time Delay

This paper is concerned with both difference and differential leader-follower games with time delay. The problem remains challenging although the leader-follower game for delay-free system has been well studied in the past decades. The main obstacle encountered is the noncausality of strategy design caused by the delay. The key technique developed to overcome the difficulty is the introduction of the new co-states which capture the future information of the control and the new state which contains the past effects. The novel contributions of this paper are as follows. First, the sufficient and necessary solvability condition is given to ensure the existence of a unique open-loop Stackelberg strategy for the difference game. Second, the open-loop strategy is explicitly obtained in terms of decoupled and symmetric Riccati equations. Last but not least, a unique strategy for continuous time systems is also given by applying the techniques developed in this paper.