A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [31] Teaching Web Services and Service-Oriented Architecture using Mobile Platforms
    Sherriff, Mark
    2010 IEEE FRONTIERS IN EDUCATION CONFERENCE (FIE), 2010,
  • [32] An independent time optimized hybrid infrastructure for big data analytics
    Vats, Satvik
    Sagar, B. B.
    MODERN PHYSICS LETTERS B, 2020, 34 (28):
  • [33] Service Oriented Big Data Management for Transport
    Kemp, Gavin
    Vargas-Solar, Genoveva
    Da Silva, Catarina Ferreira
    Ghodous, Parisa
    Collet, Christine
    SMART CITIES, GREEN TECHNOLOGIES, AND INTELLIGENT TRANSPORT SYSTEMS (SMARTGREENS 2015), 2015, 579 : 267 - 281
  • [34] Service-Oriented Architecture for Intelligent Management with Data Analytics and Visualization
    Lin, Hsuan-Yu
    Chiu, Yu-Hsuan
    Liao, Wei-Chieh
    Chang, Ray-, I
    2019 IEEE 12TH CONFERENCE ON SERVICE-ORIENTED COMPUTING AND APPLICATIONS (SOCA 2019), 2019, : 73 - 78
  • [35] An e-engineering framework based on service-oriented architecture and agent technologies
    Kuk, Seung Hak
    Oh, Il Noh
    Kim, Hyeon Soo
    Lee, Jai-Kyung
    Park, Seong-Whan
    PROCEEDINGS OF THE 2007 11TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, VOLS 1 AND 2, 2007, : 429 - +
  • [36] An e-Engineering framework based on service-oriented architecture and agent technologies
    Kuk, Seung Hak
    Kim, Hyeon Soo
    Lee, Jai-Kyung
    Han, Seungho
    Park, Seong-Whan
    COMPUTERS IN INDUSTRY, 2008, 59 (09) : 923 - 935
  • [37] Analysis of Big Data Technologies and Methods
    Garcia, Ted
    Wang, Taehyung George
    2013 IEEE SEVENTH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2013), 2013, : 244 - 251
  • [38] Service-Oriented Business Intelligence
    Abello, Alberto
    Romero, Oscar
    BUSINESS INTELLIGENCE, 2012, 96 : 156 - 185
  • [39] Web services, service-oriented computing, and service-oriented architecture: Separating hype from reality
    Erickson, John
    Siau, Keng
    JOURNAL OF DATABASE MANAGEMENT, 2008, 19 (03) : 42 - 54
  • [40] Service-oriented Sensor Data Interoperability for IEEE 1451 Smart Transducers
    Song, Eugene Y.
    Lee, Kang B.
    I2MTC: 2009 IEEE INSTRUMENTATION & MEASUREMENT TECHNOLOGY CONFERENCE, VOLS 1-3, 2009, : 1016 - 1021
12345