Dynamic programming for deterministic discrete-time systems with uncertain gain

被引：20
|
作者：
de Cooman, G [1 ]
Troffaes, MCM [1 ]
机构：
[1] Univ Ghent, Onderzoeksgrp SYSTeMS, B-9052 Zwijnaarde, Belgium
来源：
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING | 2005年 / 39卷 / 2-3期
关键词：
optimal control; dynamic programming; uncertainty; imprecise probabilities; lower previsions; sets of probabilities;
D O I：
10.1016/j.ijar.2004.10.004
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
We generalise the optimisation technique of dynamic programming for discrete-time systems with an uncertain gain function. We assume that uncertainty about the gain function is described by an imprecise probability model, which generalises the well-known Bayesian, or precise, models. We compare various optimality criteria that can be associated with such a model, and which coincide in the precise case: maximality, robust optimality and maximinity. We show that (only) for the first two an optimal feedback can be constructed by solving a Bellman-like equation. (c) 2004 Published by Elsevier Inc.
引用
收藏
页码：257 / 278
页数：22
相关论文
共 50 条
  • [31] Tracking Control of Discrete-Time System With Dynamic Event-Based Adaptive Dynamic Programming
    Ming, Zhongyang
    Zhang, Huaguang
    Yan, Yuqing
    Zhang, Juan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (08) : 3570 - 3574
  • [32] Policy Optimization Adaptive Dynamic Programming for Optimal Control of Input-Affine Discrete-Time Nonlinear Systems
    Lin, Mingduo
    Zhao, Bo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (07): : 4339 - 4350
  • [33] On the impulse response peak of discrete-time uncertain LTI systems
    Chesi, Graziano
    Shen, Tiantian
    IFAC PAPERSONLINE, 2023, 56 (02): : 539 - 543
  • [34] Reliable Control of Uncertain Delayed Discrete-time Systems with SQC
    ZHANG, Xian
    YANG, Xinrong
    LIU, Ying
    PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, : 2029 - 2033
  • [35] Robust H∞ filters for uncertain discrete-time stochastic systems
    Boukili, Bensalem
    Hmamed, Abdelaziz
    Tadeo, Fernando
    201415TH INTERNATIONAL CONFERENCE ON SCIENCES & TECHNIQUES OF AUTOMATIC CONTROL & COMPUTER ENGINEERING (STA'2014), 2014, : 95 - 99
  • [36] Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays
    Qinglai Wei
    Ding Wang
    Dehua Zhang
    Neural Computing and Applications, 2013, 23 : 1851 - 1863
  • [37] Optimal control of uncertain quantized linear discrete-time systems
    Zhao, Q.
    Xu, H.
    Jagannathan, S.
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2015, 29 (03) : 325 - 345
  • [38] Dual iterative adaptive dynamic programming for a class of discrete-time nonlinear systems with time-delays
    Wei, Qinglai
    Wang, Ding
    Zhang, Dehua
    NEURAL COMPUTING & APPLICATIONS, 2013, 23 (7-8) : 1851 - 1863
  • [39] Stable iterative adaptive dynamic programming algorithm with approximation errors for discrete-time nonlinear systems
    Qinglai Wei
    Derong Liu
    Neural Computing and Applications, 2014, 24 : 1355 - 1367
  • [40] Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems
    Luo, Biao
    Liu, Derong
    Huang, Tingwen
    Yang, Xiong
    Ma, Hongwen
    INFORMATION SCIENCES, 2017, 411 : 66 - 83
12345