MTLFormer: Multi-Task Learning Guided Transformer Network for Business Process Prediction

被引:2
作者
Wang, Jiaojiao [1 ,2 ]
Huang, Jiawei [3 ]
Ma, Xiaoyu [1 ,2 ]
Li, Zhongjin [4 ]
Wang, Yaqi [3 ]
Yu, Dingguo [1 ,2 ]
机构
[1] Commun Univ Zhejiang, Inst Intelligent Media Technol, Hangzhou 310018, Peoples R China
[2] Key Lab Film & TV Media Technol Zhejiang Prov, Hangzhou 310018, Peoples R China
[3] Commun Univ Zhejiang, Coll Media Engn, Hangzhou 310018, Peoples R China
[4] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
关键词
Multi-task learning; predictive business process monitoring; self-attention; Transformer; MODELS; LSTM;
D O I
10.1109/ACCESS.2023.3298305
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The predictive business process monitoring mainly focuses on the performance prediction of business process execution, i.e., predicting the next activity, the execution time of the next activity, and the remaining time, respectively, for an ongoing process instance based on the knowledge gained from historical event logs. Although there is a specific relationship between these three tasks, recent research has focused on training separate prediction models for each task, resulting in high costs and time complexity. Additionally, existing technologies are limited in their ability to capture long-distance dependent features in process instances, further impeding prediction performance. To address these issues, this paper proposes the MTLFormer approach, which leverages the self-attention mechanism of the Transformer network and conducts multi-task parallel training through shared feature representation obtained from different tasks. Our approach reduces the time complexity of model training while simultaneously improving prediction performance. We extensively evaluate our approach on four real-life event logs, demonstrating its capability to achieve multi-task online real-time prediction and effectively improve prediction performance.
引用
收藏
页码:76722 / 76738
页数:17
相关论文
共 44 条
[1]  
ALAEDDINE H, 2021, COMPUT INTEL NEUROSC, P1
[2]   Leveraging Shallow Machine Learning to Predict Business Process Behavior [J].
Appice, Annalisa ;
Di Mauro, Nicola ;
Malerba, Donato .
2019 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (IEEE SCC 2019), 2019, :184-188
[3]  
Ba JL, 2016, arXiv
[4]   COMPREHENSIBLE PREDICTIVE MODELS FOR BUSINESS PROCESSES [J].
Breuker, Dominic ;
Matzner, Martin ;
Delfmann, Patrick ;
Becker, Joerg .
MIS QUARTERLY, 2016, 40 (04) :1009-+
[5]  
Bukhsh ZA, 2021, Arxiv, DOI arXiv:2104.00721
[6]   Learning Accurate LSTM Models of Business Processes [J].
Camargo, Manuel ;
Dumas, Marlon ;
Gonzalez-Rojas, Oscar .
BUSINESS PROCESS MANAGEMENT (BPM 2019), 2019, 11675 :286-302
[7]  
Caruana Rich, 1993, P 10 INT C MACH LEAR, P41
[8]   Multi-task prediction method of business process based on BERT and Transfer Learning [J].
Chen, Hang ;
Fang, Xianwen ;
Fang, Huan .
KNOWLEDGE-BASED SYSTEMS, 2022, 254
[9]  
Conforti Raffaele, 2013, Advanced Information Systems Engineering. 25th International Conference, CAiSE 2013. Proceedings: LNCS 7908, P116, DOI 10.1007/978-3-642-38709-8_8
[10]   An Eye into the Future: Leveraging A-priori Knowledge in Predictive Business Process Monitoring [J].
Di Francescomarino, Chiara ;
Ghidini, Chiara ;
Maggi, Fabrizio Maria ;
Petrucci, Giulio ;
Yeshchenko, Anton .
BUSINESS PROCESS MANAGEMENT, BPM 2017, 2017, 10445 :252-268