Separable dynamic programming and approximate decomposition methods

被引:12
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [41] Approximate Dynamic Programming for Relay Deployment in Multi-robot System
    Yao, Song
    Wu, Yunlong
    Zhang, Bo
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2017, PT I, 2017, 10462 : 648 - 658
  • [42] Insect pest control, approximate dynamic programming, and the management of the evolution of resistance
    Hackett, Sean C.
    Bonsall, Michael B.
    ECOLOGICAL APPLICATIONS, 2019, 29 (02)
  • [43] A kernel-based approximate dynamic programming approach: Theory and application
    Forootani, Ali
    Iervolino, Raffaele
    Tipaldi, Massimo
    Baccari, Silvio
    AUTOMATICA, 2024, 162
  • [44] Approximate dynamic programming for communication-constrained sensor network management
    Williams, Jason L.
    Fisher, John W., III
    Willsky, Alan S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (08) : 4300 - 4311
  • [45] Efficient Massively Parallel Methods for Dynamic Programming
    Im, Sungjin
    Moseley, Benjamin
    Sun, Xiaorui
    STOC'17: PROCEEDINGS OF THE 49TH ANNUAL ACM SIGACT SYMPOSIUM ON THEORY OF COMPUTING, 2017, : 798 - 811
  • [46] On regularization methods based on dynamic programming techniques
    Kindermann, S.
    Leitao, A.
    APPLICABLE ANALYSIS, 2007, 86 (05) : 611 - 632
  • [47] Adaptive Dynamic Programming for a Class of Nonlinear Control Systems with General Separable Performance Index
    Wei, Qinglai
    Liu, Derong
    Zhang, Huaguang
    ADVANCES IN NEURAL NETWORKS - ISNN 2008, PT 2, PROCEEDINGS, 2008, 5264 : 128 - +
  • [48] Dynamic assignment of a multi-skilled workforce in job shops: An approximate dynamic programming approach
    Annear, Luis Mauricio
    Akhavan-Tabatabaei, Raha
    Schmid, Verena
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 306 (03) : 1109 - 1125
  • [49] Approximate dynamic programming with post-decision states as a solution method for dynamic economic models
    Hull, Isaiah
    JOURNAL OF ECONOMIC DYNAMICS & CONTROL, 2015, 55 : 57 - 70
  • [50] Two-Stage Dynamic Programming in the Routing Problem with Decomposition
    Chentsov, A. G.
    Chentsov, P. A.
    AUTOMATION AND REMOTE CONTROL, 2023, 84 (05) : 543 - 563