A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [1] A service-oriented Grid infrastructure for biomedical data and compute services
    Arbona, Antonio
    Benkner, Siegfried
    Engelbrecht, Gerhard
    Fingberg, Jochen
    Hofmann, Martin
    Kumpf, Kai
    Lonsdale, Guy
    Woehrer, Alexander
    IEEE TRANSACTIONS ON NANOBIOSCIENCE, 2007, 6 (02) : 136 - 141
  • [2] A service-oriented framework for remote sensing big data processing
    Enayati, Roohollah
    Ravanmehr, Reza
    Aghazarian, Vahe
    EARTH SCIENCE INFORMATICS, 2023, 16 (01) : 591 - 616
  • [3] A service-oriented framework for remote sensing big data processing
    Roohollah Enayati
    Reza Ravanmehr
    Vahe Aghazarian
    Earth Science Informatics, 2023, 16 : 591 - 616
  • [4] Service-Oriented Architecture for Big Data Analytics in Smart Cities
    Al-Jaroodi, Jameela
    Mohamed, Nader
    2018 18TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2018, : 633 - 640
  • [5] Towards an Architecture for Handling Big Data in Oil and Gas Industries: Service-Oriented Approach
    Azzedin, Farag
    Ghaleb, Mustafa
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (02) : 554 - 562
  • [6] Towards a Service-Oriented Architecture for Knowledge Management in Big Data Era
    Thang Le Dinh
    Thuong-Cang Phan
    Trung Bui
    Manh Chien Vu
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2018, 14 (04) : 24 - 38
  • [7] Advanced Technologies to Support Service Discovery in Service-Oriented Systems
    Azmy, Moh Roufiq
    Suhardi
    Muhamad, Wardani
    2020 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2020, : 300 - 305
  • [8] Big Data Service Engine (BISE): Integration of Big Data Technologies for Human Centric Wellness Data
    Idris, Muhammad
    Hussain, Shujaat
    Ahmad, Mahmood
    Lee, Sungyoung
    2015 INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2015, : 244 - 248
  • [9] SERVICE-ORIENTED PREDICTIVE MAINTENANCE FOR LARGE SCALE MACHINES BASED ON PERCEPTION BIG DATA
    Yao, Bitao
    Zhou, Zude
    Xu, Wenjun
    Fang, Yilin
    Shao, Luyang
    Wang, Qiang
    Liu, Aiming
    PROCEEDINGS OF THE ASME 10TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE, 2015, VOL 2, 2015,
  • [10] Service-Oriented Big Data Analytics for Improving Buildings Energy Management in Smart Cities
    Mohamed, Nader
    Al-Jaroodi, Jameela
    Jawhar, Imad
    2018 14TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2018, : 1243 - 1248
12345