BAYESIAN REINFORCEMENT LEARNING FOR POMDP-BASED DIALOGUE SYSTEMS

被引:0
作者
Png, ShaoWei [1 ]
Pineau, Joelle [1 ]
机构
[1] McGill Univ, Sch Comp Sci, Montreal, PQ H3A 1A8, Canada
来源
2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING | 2011年
关键词
POMDPs (Partially Observable Markov Decision Processes); Spoken Dialogue; Reinforcement Learning; Bayesian Learning;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Spoken dialogue systems are gaining popularity with improvements in speech recognition technologies. Dialogue systems can be modeled effectively using POMDPs, achieving improvements in robustness. However, past research on POMDPs-based dialogue system assumes that the model parameters are known. This limitation can be addressed through model-based Bayesian reinforcement learning, which offers a rich framework for simultaneous learning and planning. However, due to the high complexity of the framework, a major challenge is to scale up these algorithms for complex dialogue systems. In this work, we show that by exploiting certain known components of the system, such as knowledge of symmetrical properties, and using an approximate online planning algorithm, we are able to apply Bayesian RL on a realistic spoken dialogue system domain.
引用
收藏
页码:2156 / 2159
页数:4
相关论文
共 21 条
[1]  
[Anonymous], 1998, ARTIFICIAL INTELLIGE
[2]  
Atrash A., 2009, IUI
[3]  
Atrash A., 2009, IJSR, V1
[4]   Rollout algorithms for stochastic scheduling problems [J].
Bertsekas, DP ;
Castañon, DA .
JOURNAL OF HEURISTICS, 1999, 5 (01) :89-108
[5]  
Dearden R., 1999, UAI
[6]  
Georgila K., 2006, ICSLP
[7]  
Kurniawati H., 2008, RSS
[8]  
Nisimura R., 2002, ICRA
[9]  
Ong S., 2009, RSS
[10]  
Paquet S., 2005, ADV ARTIFICIAL INTEL