The role of machine learning in scientific workflows

被引:21
作者
Deelman, Ewa [1 ]
Mandal, Anirban [2 ]
Jiang, Ming [3 ]
Sakellariou, Rizos [4 ]
机构
[1] Univ Southern Calif, Informat Sci Inst, Marina Del Rey, CA 90292 USA
[2] Renaissance Comp Inst, Chapel Hill, NC USA
[3] Lawrence Livermore Natl Lab, Ctr Appl Sci Comp, Livermore, CA 94550 USA
[4] Univ Manchester, Comp Sci, Manchester, Lancs, England
基金
美国国家科学基金会;
关键词
Scientific workflows; machine learning; workflow systems; anomaly detection; workflow composition; PERFORMANCE; DESIGN; SYSTEM; WEB;
D O I
10.1177/1094342019852127
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Machine learning (ML) is being applied in a number of everyday contexts from image recognition, to natural language processing, to autonomous vehicles, to product recommendation. In the science realm, ML is being used for medical diagnosis, new materials development, smart agriculture, DNA classification, and many others. In this article, we describe the opportunities of using ML in the area of scientific workflow management. Scientific workflows are key to today's computational science, enabling the definition and execution of complex applications in heterogeneous and often distributed environments. We describe the challenges of composing and executing scientific workflows and identify opportunities for applying ML techniques to meet these challenges by enhancing the current workflow management system capabilities. We foresee that as the ML field progresses, the automation provided by workflow management systems will greatly increase and result in significant improvements in scientific productivity.
引用
收藏
页码:1128 / 1139
页数:12
相关论文
共 91 条
[1]  
Abramson D, 2008, SC 08
[2]  
Albrecht M, 2012, 1 WORKSH SCAL WORKFL
[3]  
Altintas I, 2004, 16TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS, P423
[4]  
Amer M., 2012, P RCOMM BUD HUNG, P1
[5]  
[Anonymous], 2011, P 7 INT C NETW SERV
[6]  
[Anonymous], 2015, Anomaly Detection for Monitoring: A Statistical Approach to Time Series Anomaly Detection
[7]  
[Anonymous], 2012, Introductory Statistics
[8]  
[Anonymous], 2007, Work flows for e-Science
[9]  
[Anonymous], 7 IEEE INT S CLUST C
[10]   Intelligent failure prediction models for scientific workflows [J].
Bala, Anju ;
Chana, Inderveer .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (03) :980-989