On the Unreasonable Efficiency of State Space Clustering in Personalization Tasks

被引:3
作者
Dereventsov, Anton [1 ]
Vatsavai, Raju [2 ]
Webster, Clayton G. [2 ]
机构
[1] Lirio LLC, Lirio AI Res, Knoxville, TN 37923 USA
[2] Lirio LLC, Behav Reinforcement Learning Lab, Knoxville, TN USA
来源
21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS ICDMW 2021 | 2021年
关键词
D O I
10.1109/ICDMW53433.2021.00097
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this effort we consider a reinforcement learning (RL) technique for solving personalization tasks with complex reward signals. In particular, our approach is based on state space clustering with the use of a simplistic K-means algorithm as well as conventional choices of the network architectures and optimization algorithms. Numerical examples demonstrate the efficiency of different RL procedures and are used to illustrate that this technique accelerates the agent's ability to learn and does not restrict the agent's performance.
引用
收藏
页码:742 / 749
页数:8
相关论文
共 47 条
[1]  
Abel D, 2016, PR MACH LEARN RES, V48
[2]   Hierarchical Reinforcement Learning with Clustering Abstract Machines [J].
Alexey, Skrynnik ;
Panov, Aleksandr, I .
ARTIFICIAL INTELLIGENCE: (RCAI 2019), 2019, 1093 :30-43
[3]  
Aspinall MG, 2007, HARVARD BUS REV, V85, P108
[4]  
Berner C., 2019, Dota 2 with large scale deep reinforcement learning
[5]  
Bock H.-H., 2007, SELECTED CONTRIBUTIO, P161, DOI [DOI 10.1007/978-3-540-73560-1_15, DOI 10.1007/978-3-540-73560-115]
[6]   Reinforcement learning for intelligent healthcare applications: A survey [J].
Coronato, Antonio ;
Naeem, Muddasar ;
De Pietro, Giuseppe ;
Paragliola, Giovanni .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2020, 109
[7]   Hierarchical reinforcement learning with the MAXQ value function decomposition [J].
Dietterich, TG .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2000, 13 :227-303
[8]   Automatic web content personalization through reinforcement learning [J].
Ferretti, Stefano ;
Mirri, Silvia ;
Prandi, Catia ;
Salomoni, Paola .
JOURNAL OF SYSTEMS AND SOFTWARE, 2016, 121 :157-169
[9]  
Ghavamzadeh M., 2001, ICML
[10]   Personalized medicine: revolutionizing drug discovery and patient care [J].
Ginsburg, GS ;
McCarthy, JJ .
TRENDS IN BIOTECHNOLOGY, 2001, 19 (12) :491-496