Orchestrating BigData Analysis Workflows

被引:28
|
作者
Ranjan, Rajiv [1 ]
Garg, Saurabh [2 ]
Khoskbar, Ali Reza [3 ]
Solaiman, Ellis [1 ]
James, Philip [1 ]
Georgakopoulos, Dimitrios [4 ]
机构
[1] Newcastle Univ, Newcastle Upon Tyne, Tyne & Wear, England
[2] Univ Tasmania, Hobart, Tas, Australia
[3] Australian Natl Univ, Canberra, ACT, Australia
[4] Swinburne Univ Technol, Hawthorn, Vic, Australia
来源
IEEE CLOUD COMPUTING | 2017年 / 4卷 / 03期
基金
英国工程与自然科学研究理事会;
关键词
BigData; cloud computing; cloud tidbits;
D O I
10.1109/MCC.2017.55
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Data analytics has become not only an essential part of day-to-day decision making, but also reinforces long-term strategic decisions. Whether it is real-time fraud detection, resource management, tracking and prevention of disease outbreak, natural disaster management or intelligent traffic management, the extraction and exploitation of insightful information from unparalleled quantities of data (Big-Data) is now a fundamental part of all decision making processes. Success in making smart decisions by analyzing BigData is possible due to the availability of improved analytical capabilities, increased access to different data sources, and cheaper and improved computing power in the form of cloud computing. However, BigData analysis is far more complicated than the perception created by the recent publicity. For example, one of the myths is that BigData analysis is driven purely by the innovation of new data mining and machine learning algorithms.
引用
收藏
页码:20 / 28
页数:9
相关论文
共 50 条
  • [1] Orchestrating Data-Centric Workflows
    Barker, Adam
    Weissman, Jon B.
    van Hemert, Jano
    CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 210 - 217
  • [2] Orchestrating Big Data Analysis Workflows in the Cloud: Research Challenges, Survey, and Future Directions
    Barika, Mutaz
    Garg, Saurabh
    Zomaya, Albert Y.
    Wang, Lizhe
    Van Moorsel, Aad
    Ranjan, Rajiv
    ACM COMPUTING SURVEYS, 2019, 52 (05)
  • [3] Orchestrating and Scheduling System for Workflows in Heterogeneous and Dynamic Environment
    Liang, Wenliang
    Lin, Hao
    Shen, Haihua
    Wang, Enbo
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [4] Bigdata Analysis and Comparison of Bigdata Analytic Approches
    Malhotra, Shweta
    Doja, M. N.
    Alam, Bashir
    Alam, Mansaf
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2017, : 309 - 314
  • [5] DYFLOW: A flexible framework for orchestrating scientific workflows on supercomputers
    Singhal, Swati
    Sussman, Alan
    Wolf, Matthew
    Mehta, Kshitij
    Choi, Jong Youl
    50TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOP PROCEEDINGS - ICPP WORKSHOPS '21, 2021,
  • [6] Orchestrating and coordinating scientific/engineering workflows using GridShell
    Walker, E
    Minyard, T
    13TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, PROCEEDINGS, 2004, : 270 - 271
  • [7] Orchestrating Inter-organisational Logistics Workflows on the Cloud
    Karakostas, Bill
    Pal, Kamalendu
    VIRTUAL AND NETWORKED ORGANIZATIONS, EMERGENT TECHNOLOGIES, AND TOOLS, 2012, 248 : 137 - 144
  • [8] Workflows orchestrating workflows: thousands of queries and their fault tolerance using APIs of omics web resources
    Mohammed, Yassene
    2018 IEEE 14TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE 2018), 2018, : 299 - 300
  • [9] Maestro: Orchestrating Concurrent Application Workflows in Mobile Device Clouds
    Viswanathan, Hariharasudhan
    Pandey, Parul
    Pompili, Dario
    2016 IEEE INTERNATIONAL CONFERENCE ON AUTONOMIC COMPUTING (ICAC), 2016, : 257 - 262
  • [10] QueueFlower: Orchestrating Microservice Workflows via Dynamic Queue Balancing
    Cao, Hongchen
    Liu, Xinrui
    Guo, Hengquan
    He, Jingzhu
    Liu, Xin
    2024 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2024, 2024, : 1293 - 1299