Dynamic programming for deterministic discrete-time systems with uncertain gain

被引：20
|
作者：
de Cooman, G [1 ]
Troffaes, MCM [1 ]
机构：
[1] Univ Ghent, Onderzoeksgrp SYSTeMS, B-9052 Zwijnaarde, Belgium
来源：
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING | 2005年 / 39卷 / 2-3期
关键词：
optimal control; dynamic programming; uncertainty; imprecise probabilities; lower previsions; sets of probabilities;
D O I：
10.1016/j.ijar.2004.10.004
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We generalise the optimisation technique of dynamic programming for discrete-time systems with an uncertain gain function. We assume that uncertainty about the gain function is described by an imprecise probability model, which generalises the well-known Bayesian, or precise, models. We compare various optimality criteria that can be associated with such a model, and which coincide in the precise case: maximality, robust optimality and maximinity. We show that (only) for the first two an optimal feedback can be constructed by solving a Bellman-like equation. (c) 2004 Published by Elsevier Inc.
引用
收藏
页码：257 / 278
页数：22
相关论文
共 50 条
  • [21] Local Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Xu, Yancai
    Lin, Qiao
    Liu, Derong
    Song, Ruizhuo
    ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 148 - 153
  • [22] A Novel Approximate Dynamic Programming Structure for Optimal Control of Discrete-Time Time-Varying Nonlinear Systems
    Sun, Jiayue
    Xu, Zhiming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (08) : 3835 - 3839
  • [23] Robust Optimal Control of Uncertain Discrete-Time Multiagent Systems With Digraphs
    Zhang, Zhuo
    Shi, Yang
    Zhang, Zexu
    Zhang, Shouxu
    Li, Huiping
    Xiao, Bing
    Yan, Weisheng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (02): : 861 - 871
  • [24] A set evolution approach to the control of uncertain systems with discrete-time measurement
    Rigal, Sylvain
    JOURNAL OF CONVEX ANALYSIS, 2006, 13 (02) : 443 - 461
  • [25] Robust Stabilization of Discrete-Time Uncertain Nonlinear Systems
    A. V. Savkin
    I. R. Petersen
    Journal of Optimization Theory and Applications, 1998, 96 : 87 - 107
  • [26] Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Liu, Derong
    Lin, Hanquan
    IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (03) : 840 - 853
  • [27] An Event-Triggered Heuristic Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems
    Wang, Ziyang
    Wei, Qinglai
    Liu, Derong
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 741 - 748
  • [28] Discrete-Time Approximation for Uncertain Linear Systems with Time-Delays
    H'mida, Bemri
    Dhaou, Soudani
    2015 7TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC), 2014, : 390 - 395
  • [29] Event-Triggered Control of Discrete-Time Zero-Sum Games via Deterministic Policy Gradient Adaptive Dynamic Programming
    Zhang, Yongwei
    Zhao, Bo
    Liu, Derong
    Zhang, Shunchao
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08): : 4823 - 4835
  • [30] Construction of a Destabilizing Nonlinearity for Discrete-Time Uncertain Lurye Systems
    Patartics, Balint
    Seiler, Peter
    Carrasco, Joaquin
    Vanek, Balint
    IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 2605 - 2610
12345