Time Matters: Time-Aware LSTMs for Predictive Business Process Monitoring

被引:17
作者
An Nguyen [1 ]
Chatterjee, Srijeet [1 ]
SvenWeinzierl [2 ]
Schwinn, Leo [1 ]
Matzner, Martin [2 ]
Eskofier, Bjoern [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg FAU, Dept Comp Sci, Erlangen, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg FAU, Inst Informat Syst, Nurnberg, Germany
来源
PROCESS MINING WORKSHOPS, ICPM 2020 INTERNATIONAL WORKSHOPS | 2021年 / 406卷
关键词
Predictive business process monitoring; Deep learning; Recurrent neural network; LSTM; Time-Awareness;
D O I
10.1007/978-3-030-72693-5_9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predictive business process monitoring (PBPM) aims to predict future process behavior during ongoing process executions based on event log data. Especially, techniques for the next activity and timestamp prediction can help to improve the performance of operational business processes. Recently, many PBPM solutions based on deep learning were proposed by researchers. Due to the sequential nature of event log data, a common choice is to apply recurrent neural networks with long short-term memory (LSTM) cells. We argue, that the elapsed time between events is informative. However, current PBPM techniques mainly use "vanilla" LSTM cells and hand-crafted time-related control flow features. To better model the time dependencies between events, we propose a new PBPM technique based on time-aware LSTM (T-LSTM) cells. T-LSTM cells incorporate the elapsed time between consecutive events inherently to adjust the cell memory. Furthermore, we introduce cost-sensitive learning to account for the common class imbalance in event logs. Our experiments on publicly available benchmark event logs indicate the effectiveness of the introduced techniques.
引用
收藏
页码:112 / 123
页数:12
相关论文
共 18 条
[1]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[2]   Patient Subtyping via Time-Aware LSTM Networks [J].
Baytas, Inci M. ;
Xiao, Cao ;
Zhang, Xi ;
Wang, Fei ;
Jain, Anil K. ;
Zhou, Jiayu .
KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, :65-74
[3]   LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT [J].
BENGIO, Y ;
SIMARD, P ;
FRASCONI, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :157-166
[4]   COMPREHENSIBLE PREDICTIVE MODELS FOR BUSINESS PROCESSES [J].
Breuker, Dominic ;
Matzner, Martin ;
Delfmann, Patrick ;
Becker, Joerg .
MIS QUARTERLY, 2016, 40 (04) :1009-+
[5]   Learning Accurate LSTM Models of Business Processes [J].
Camargo, Manuel ;
Dumas, Marlon ;
Gonzalez-Rojas, Oscar .
BUSINESS PROCESS MANAGEMENT (BPM 2019), 2019, 11675 :286-302
[6]   Predictive Process Monitoring Methods: Which One Suits Me Best? [J].
Di Francescomarino, Chiara ;
Ghidini, Chiara ;
Maggi, Fabrizio Maria ;
Milani, Fredrik .
BUSINESS PROCESS MANAGEMENT (BPM 2018), 2018, 11080 :462-479
[7]   Predicting process behaviour using deep learning [J].
Evermann, Joerg ;
Rehse, Jana-Rebecca ;
Fettke, Peter .
DECISION SUPPORT SYSTEMS, 2017, 100 :129-140
[8]   LSTM: A Search Space Odyssey [J].
Greff, Klaus ;
Srivastava, Rupesh K. ;
Koutnik, Jan ;
Steunebrink, Bas R. ;
Schmidhuber, Juergen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (10) :2222-2232
[9]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[10]  
Khan A, 2021, Arxiv, DOI arXiv:1802.00938