A Service-Oriented Infrastructure for Teaching Big Data Technologies

被引:1
|
作者
Sukhoroslov, Oleg [1 ,2 ,3 ]
机构
[1] Russian Acad Sci, Inst Informat Transmiss Problems, Kharkevich Inst, Moscow, Russia
[2] Yandex Sch Data Anal, Moscow, Russia
[3] Higher Sch Econ, Moscow, Russia
来源
SUPERCOMPUTING, RUSCDAYS 2017 | 2017年 / 793卷
基金
俄罗斯科学基金会;
关键词
Big Data; Parallel programming; Distributed computing; Hadoop; MapReduce; Spark; Web-based interfaces; Web services;
D O I
10.1007/978-3-319-71255-0_41
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.
引用
收藏
页码:505 / 515
页数:11
相关论文
共 50 条
  • [21] Teaching Service-Oriented Programming to CS and SE Undergraduate Students
    Liu, Xumin
    Raj, Rajendra K.
    Reichlmayr, Thomas J.
    Liu, Chunmei
    Pantaleev, Alex
    2013 IEEE FRONTIERS IN EDUCATION CONFERENCE, 2013,
  • [22] A Web Service-Oriented Approach to Teaching CS/IS1
    Lim, Billy
    Hosack, Bryan
    Vogt, Paul
    SIGCSE 10: PROCEEDINGS OF THE 41ST ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, 2010, : 131 - 132
  • [23] Integrating Big Data technologies in a dynamic environment EIAH dedicated to e-learning systems based on cloud infrastructure
    Dahdouh, K.
    Dakkak, Ahmed
    Oughdir, Lahcen
    ICCWCS'17: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTING AND WIRELESS COMMUNICATION SYSTEMS, 2017,
  • [24] QaaS (quality as a service) model for web services using big data technologies
    Ahmad, Faisal
    Sarkar, Anirban
    ENTERPRISE INFORMATION SYSTEMS, 2017, 11 (09) : 1352 - 1373
  • [25] Data Management Architecture for Service-Oriented Maritime Testbeds
    Moeller, Julius
    Jankowski, Dennis
    Lamm, Arne
    Hahn, Axel
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 3 : 631 - 649
  • [26] Service-oriented Architecture in IT
    Xin, Chen
    2009 ASIA-PACIFIC CONFERENCE ON INFORMATION PROCESSING (APCIP 2009), VOL 2, PROCEEDINGS, 2009, : 493 - 496
  • [27] Mechanisms for the Construction of the Service-Oriented Information System of Educational Institution Based on Technologies of Data Integration and Virtualization
    Koskin, Aleksandr
    Uzharinskiy, Anton
    Averchenkov, Andrey
    Ivkina, Nataliya
    Rytov, Mihail
    CREATIVITY IN INTELLIGENT TECHNOLOGIES AND DATA SCIENCE, (CIT&DS), 2017, 754 : 177 - 186
  • [28] Schema of Big Data Service Oriented to Ocean Shipping Service Integration with WSN
    Zhao, M.
    Ma, J. W.
    Luo, H. L.
    Chen, N.
    Sun, Y.
    INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENVIRONMENTAL ENGINEERING (CSEE 2015), 2015, : 712 - 717
  • [29] Integration of Wireless Sensor and Actuator Nodes With IT Infrastructure Using Service-Oriented Architecture
    Kyusakov, Rumen
    Eliasson, Jens
    Delsing, Jerker
    van Deventer, Jan
    Gustafsson, Jonas
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2013, 9 (01) : 43 - 51
  • [30] Efficient Service Discovery Using Social Service Network Based on Big Data Infrastructure
    Paik, Incheon
    Koshiba, Yutaka
    Siriweera, T. H. Akila S.
    2017 IEEE 11TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2017), 2017, : 166 - 173