Learning to Act: A Reinforcement Learning Approach to Recommend the Best Next Activities

被引:10
作者
Branchi, Stefano [1 ]
Di Francescomarino, Chiara [1 ]
Ghidini, Chiara [1 ]
Massimo, David [2 ]
Ricci, Francesco [2 ]
Ronzani, Massimiliano [1 ]
机构
[1] Fdn Bruno Kessler, Trento, Italy
[2] Free Univ Bozen Bolzano, Bolzano, Italy
来源
BUSINESS PROCESS MANAGEMENT FORUM | 2022年 / 458卷
关键词
Prescriptive Process Monitoring; Reinforcement Learning; Next activity recommendations;
D O I
10.1007/978-3-031-16171-1_9
中图分类号
F [经济];
学科分类号
02 ;
摘要
The rise of process data availability has recently led to the development of data-driven learning approaches. However, most of these approaches restrict the use of the learned model to predict the future of ongoing process executions. The goal of this paper is moving a step forward and leveraging available data to learning to act, by supporting users with recommendations derived from an optimal strategy (measure of performance). We take the optimization perspective of one process actor and we recommend the best activities to execute next, in response to what happens in a complex external environment, where there is no control on exogenous factors. To this aim, we investigate an approach that learns, by means of Reinforcement Learning, the optimal policy from the observation of past executions and recommends the best activities to carry on for optimizing a Key Performance Indicator of interest. The validity of the approach is demonstrated on two scenarios taken from real-life data.
引用
收藏
页码:137 / 154
页数:18
相关论文
共 25 条
[1]  
Fahrenkrog-Petersen SA, 2020, Arxiv, DOI arXiv:1905.09568
[2]  
[Anonymous], 2015, BPM, DOI 10.4121/uuid:270fd440-1057-4fb9-89a9-b699b47990f5
[3]  
De Giacomo G., 2019, ICAPS, V29, P128, DOI 10.1609/icaps.v29i1.3549
[4]   Design and Evaluation of a Process-aware Recommender System based on Prescriptive Analytics [J].
de Leoni, Massimiliano ;
Dees, Marcus ;
Reulink, Laurens .
2020 2ND INTERNATIONAL CONFERENCE ON PROCESS MINING (ICPM 2020), 2020, :9-16
[5]   Predictive Process Monitoring Methods: Which One Suits Me Best? [J].
Di Francescomarino, Chiara ;
Ghidini, Chiara ;
Maggi, Fabrizio Maria ;
Milani, Fredrik .
BUSINESS PROCESS MANAGEMENT (BPM 2018), 2018, 11080 :462-479
[6]  
Dumas M., 2021, CEUR WORKSHOP P, V2938, P23
[7]  
Dumas M, 2022, Arxiv, DOI arXiv:2201.12855
[8]  
Groger C., 2014, INT C BUS INF SYST, P25, DOI DOI 10.1007/978-3-319-06695-0_3
[9]   Voronoi-Based Multi-Robot Autonomous Exploration in Unknown Environments via Deep Reinforcement Learning [J].
Hu, Junyan ;
Niu, Hanlin ;
Carrasco, Joaquin ;
Lennox, Barry ;
Arvin, Farshad .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) :14413-14423
[10]   Reinforcement learning based resource allocation in business process management [J].
Huang, Zhengxing ;
van der Aalst, W. M. P. ;
Lu, Xudong ;
Duan, Huilong .
DATA & KNOWLEDGE ENGINEERING, 2011, 70 (01) :127-145