A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引：1
|
作者：
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构：
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源：
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金：
俄罗斯科学基金会;
关键词：
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I：
10.1007/978-3-319-71255-0_41
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码：505 / 515
页数：11
相关论文
共 50 条
  • [41] Exploration and Practice of Data Mining Course Teaching Oriented Big Data
    Lei, Gang
    Xiong, Chen
    PROCEEDINGS OF THE 2017 7TH INTERNATIONAL CONFERENCE ON MANUFACTURING SCIENCE AND ENGINEERING (ICMSE 2017), 2017, 128 : 47 - 50
  • [42] Profit optimization in service-oriented data market: A Stackelberg game approach
    Shen, Bo
    Shen, Yulong
    Ji, Wen
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 95 : 17 - 25
  • [43] Latest Progress and Infrastructure Innovations of Big Data Technology
    Chen, Shangyi
    Li, Wei
    Li, Min
    Zhang, Xiaofei
    Min, Yue
    2014 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA (CCBD), 2014, : 8 - 15
  • [44] BLAST Using Big Data Technologies: A Survey
    Gaikwad, Mayur
    Ahirrao, Swati
    2018 FOURTH INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION CONTROL AND AUTOMATION (ICCUBEA), 2018,
  • [45] Big Data Infrastructure, Data Visualisation and Challenges
    Venkatraman, Ramanathan
    Venkatraman, Sitalakshmi
    3RD INTERNATIONAL CONFERENCE ON BIG DATA AND INTERNET OF THINGS (BDIOT 2019), 2018, : 13 - 17
  • [46] Big Data Infrastructure for Aviation Data Analytics
    Murugan, Anandavel
    Mylaraswamy, Dinkar
    Xu, Brian
    Dietrich, Paul
    2014 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2014, : 87 - 92
  • [47] Edge Mashups for Service-Oriented Collaboration
    Birman, Ken
    Cantwell, Jared
    Freedman, Daniel
    Huang, Qi
    Nikolov, Petko
    Ostrowski, Krzysztof
    COMPUTER, 2009, 42 (05) : 90 - 94
  • [48] ISSUES IN IT SERVICE-ORIENTED REQUIREMENTS ENGINEERING
    Lichtenstein, Sharman
    Nguyen, Lemai
    Hunter, Alexia
    AUSTRALASIAN JOURNAL OF INFORMATION SYSTEMS, 2005, 13 (01) : 176 - 191
  • [49] Master as a Service A multidisciplinary approach to Big Data teaching
    Navarro, Joan
    Zaballos, Agustin
    Fonseca, David
    Torres-Kompen, Ricardo
    TEEM'19: SEVENTH INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ECOSYSTEMS FOR ENHANCING MULTICULTURALITY, 2019, : 534 - 538
  • [50] Service-oriented paradigms in industrial automation
    Jammes, Francois
    Smit, Harm
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2005, 1 (01) : 62 - 70
12345