Separable dynamic programming and approximate decomposition methods

被引:12
作者
Bertsekas, Dimitri P. [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
关键词
dynamic programming; optical control; reachability; separable problems;
D O I
10.1109/TAC.2007.895901
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider control, planning, and resource allocation problems involving several independent subsystems that are coupled through a control/decision constraint. We discuss one-step lookahead methods that use an approximate cost-to-go function derived from the solution of single subsystem problems. We propose a new method for constructing such approximations, and derive bounds on the performance of the associated suboptimal policies. We then specialize this method to problems of reachability of target tubes that have the form of a box (a Cartesian product of subsystem tubes). We thus obtain inner approximating tubes, which are the union of a finite number of boxes, each involving single subsystem calculations.
引用
收藏
页码:911 / 916
页数:6
相关论文
共 50 条
  • [31] Nested Benders decomposition and dynamic programming for reservoir optimisation
    Archibald, TW
    Buchanan, CS
    McKinnon, KIM
    Thomas, LC
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1999, 50 (05) : 468 - 479
  • [32] Convexity and Feedback in Approximate Dynamic Programming for Delivery Time Slot Pricing
    Lebedev, Denis
    Margellos, Kostas
    Goulart, Paul
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (02) : 893 - 900
  • [33] Accelerated Point-Wise Maximum Approach to Approximate Dynamic Programming
    Beuchat, Paul Nathaniel
    Warrington, Joseph
    Lygeros, John
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (01) : 251 - 266
  • [34] An approximate dynamic programming approach for the maintenance optimisation of networked critical infrastructures
    Li, Wanshan
    Zhang, Chi
    Li, Liuquan
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 2024, 75 (05) : 921 - 941
  • [35] Approximate Dynamic Programming for Selective Maintenance in Series-Parallel Systems
    Ahadi, Khatereh
    Sullivan, Kelly M.
    IEEE TRANSACTIONS ON RELIABILITY, 2020, 69 (03) : 1147 - 1164
  • [36] Using Approximate Dynamic Programming to Maximize Regenerative Energy Utilization for Metro
    Xun, Jing
    Liu, Tong
    Ning, Bin
    Liu, Yafei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (09) : 3650 - 3662
  • [37] Approximate dynamic programming for communication-constrained sensor network management
    Williams, Jason L.
    Fisher, John W., III
    Willsky, Alan S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (08) : 4300 - 4311
  • [38] A kernel-based approximate dynamic programming approach: Theory and application
    Forootani, Ali
    Iervolino, Raffaele
    Tipaldi, Massimo
    Baccari, Silvio
    AUTOMATICA, 2024, 162
  • [39] Fertilizer application management under uncertainty using approximate dynamic programming
    Gokalp, Elvan
    COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 161 (161)
  • [40] Approximate Dynamic Programming for Relay Deployment in Multi-robot System
    Yao, Song
    Wu, Yunlong
    Zhang, Bo
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2017, PT I, 2017, 10462 : 648 - 658