A survey of large-scale analytical query processing in MapReduce

被引:0
|
作者
Christos Doulkeridis
Kjetil Nørvåg
机构
[1] University of Piraeus,Department of Digital Systems
[2] Norwegian University of Science and Technology,Department of Computer and Information Science
来源
The VLDB Journal | 2014年 / 23卷
关键词
MapReduce; Survey; Data analysis; Query processing; Large-scale; Big Data;
D O I
暂无
中图分类号
学科分类号
摘要
Enterprises today acquire vast volumes of data from different sources and leverage this information by means of data analysis to support effective decision-making and provide new functionality and services. The key requirement of data analytics is scalability, simply due to the immense volume of data that need to be extracted, processed, and analyzed in a timely fashion. Arguably the most popular framework for contemporary large-scale data analytics is MapReduce, mainly due to its salient features that include scalability, fault-tolerance, ease of programming, and flexibility. However, despite its merits, MapReduce has evident performance limitations in miscellaneous analytical tasks, and this has given rise to a significant body of research that aim at improving its efficiency, while maintaining its desirable properties. This survey aims to review the state of the art in improving the performance of parallel query processing using MapReduce. A set of the most significant weaknesses and limitations of MapReduce is discussed at a high level, along with solving techniques. A taxonomy is presented for categorizing existing research on MapReduce improvements according to the specific problem they target. Based on the proposed taxonomy, a classification of existing research is provided focusing on the optimization objective. Concluding, we outline interesting directions for future parallel data processing systems.
引用
收藏
页码:355 / 380
页数:25
相关论文
共 50 条
  • [41] Efficient Aggregation Query Processing for Large-Scale Multidimensional Data by Combining RDB and KVS
    Watari, Yuya
    Keyaki, Atsushi
    Miyazaki, Jun
    Nakamura, Masahide
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2018, PT I, 2018, 11029 : 134 - 149
  • [42] Efficient and robust serial query processing approach for large-scale wireless sensor networks
    Boukerche, A.
    Mostefaoui, A.
    Melkemi, M.
    AD HOC NETWORKS, 2016, 47 : 82 - 98
  • [43] Query by Example in Large-Scale Code Repositories
    Balachandran, Vipin
    2015 31ST INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME) PROCEEDINGS, 2015, : 467 - 476
  • [44] Large Scale Hamming Distance Query Processing
    Liu, Alex X.
    Shen, Ke
    Torng, Eric
    IEEE 27TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2011), 2011, : 553 - 564
  • [45] A Survey on Processing of Large-Scale 3D Point Cloud
    Liu, Xinying
    Meng, Weiliang
    Guo, Jianwei
    Zhang, Xiaopeng
    E-LEARNING AND GAMES, 2016, 9654 : 267 - 279
  • [47] Large-scale processing of coals
    Procycat, F
    ZEITSCHRIFT DES VEREINES DEUTSCHER INGENIEURE, 1933, 77 : 893 - 897
  • [48] Intra-query Adaptivity for MapReduce Query Processing Systems
    Lucas Filho, Edson Ramiro
    de Almeida, Eduardo Cunha
    Le Traon, Yves
    PROCEEDINGS OF THE 18TH INTERNATIONAL DATABASE ENGINEERING AND APPLICATIONS SYMPOSIUM (IDEAS14), 2014, : 380 - 381
  • [49] Out-of-core GPU Memory Management for MapReduce-based Large-scale Graph Processing
    Shirahata, Koichi
    Sato, Hitoshi
    Matsuoka, Satoshi
    2014 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2014, : 221 - 229
  • [50] A large-scale graph learning framework of technological gatekeepers by MapReduce
    School of Economics and Management, Beihang University, Beijing, China
    不详
    Proc. IEEE Int. Parallel Distrib. Process. Symp. Workshops, IPDPSW, (1997-2003):