A scientific workflow management system architecture and its scheduling based on cloud service platform for manufacturing big data analytics

被引:63
作者
Li, Xiu [1 ]
Song, Jingdong [1 ]
Huang, Biqing [2 ]
机构
[1] Tsinghua Univ, Grad Sch Shenzhen, Div Informat Sci & Technol, Shenzhen 518055, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Manufacturing big data; Scientific workflow; Scheduling algorithm; Cloud service platform; IMPLEMENTATION; PERFORMANCE;
D O I
10.1007/s00170-015-7804-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To improve the efficiency and productivity of modern manufacturing, the requirements for enterprises are discussed. The new emerged technologies such as cloud computing and internet of things are analyzed and the bottlenecks faced by enterprises in manufacturing big data analytics are investigated. Scientific workflow technology as a method to solve the problems is introduced and an architecture of scientific workflow management system based on cloud manufacturing service platform is proposed. The functions of each layer in the architecture are described in detail and implemented with an existing workflow system as a case study. The workflow scheduling algorithm is the key issue of management system, and the related work is reviewed. This paper takes the general problems of existing algorithms as the motivation to propose a novel scheduling algorithm called MP (max percentages) algorithm. The simulation results indicate that the proposed algorithm has performed better than the other five classic algorithms with respect to both the total completion time and load balancing level.
引用
收藏
页码:119 / 131
页数:13
相关论文
共 45 条
[1]   Analysis, evaluation, and comparison of algorithms for scheduling task graphs on parallel processors [J].
Ahmad, I ;
Kwok, YK ;
Wu, MY .
SECOND INTERNATIONAL SYMPOSIUM ON PARALLEL ARCHITECTURES, ALGORITHMS, AND NETWORKS (I-SPAN '96), PROCEEDINGS, 1996, :207-213
[2]  
[Anonymous], 2010, MCKINSEY Q
[3]   Advances on cloud services and cloud computing [J].
Barolli, Leonard ;
Chen, Xiaofeng ;
Xhafa, Fatos .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (08) :1985-1987
[4]   Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis [J].
Barseghian, Derik ;
Altintas, Ilkay ;
Jones, Matthew B. ;
Crawl, Daniel ;
Potter, Nathan ;
Gallagher, James ;
Cornillon, Peter ;
Schildhauer, Mark ;
Borer, Elizabeth T. ;
Seabloom, Eric W. ;
Hosseini, Parviez R. .
ECOLOGICAL INFORMATICS, 2010, 5 (01) :42-50
[5]  
Bubak M, 2006, P CGW, V6, P1
[6]  
Casanova H., 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556), P349, DOI 10.1109/HCW.2000.843757
[7]   A Weighted Mean Time Min-Min Max-Min Selective Scheduling Strategy for Independent Tasks on Grid [J].
Chauhan, Sameer Singh ;
Joshi, R. C. .
2010 IEEE 2ND INTERNATIONAL ADVANCE COMPUTING CONFERENCE, 2010, :4-9
[8]  
Deelman E., 2005, Scientific Programming, V13, P219
[9]   Watchdog Agent - an infotronics-based prognostics approach for product performance degradation assessment and prediction [J].
Djurdjanovic, D ;
Lee, J ;
Ni, J .
ADVANCED ENGINEERING INFORMATICS, 2003, 17 (3-4) :109-125
[10]   A novel approach of networked manufacturing collaboration: fractal web-based extended enterprise [J].
Dong, HZ ;
Liu, DX ;
Zhao, YW ;
Chen, Y .
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2005, 26 (11-12) :1436-1442