Spark : A Big Data Processing Platform Based On Memory Computing

被引：25

作者：

Han, Zhijie ^{[1
]}

Zhang, Yujie ^{[2
]}

机构：

[1] Nanjing Univ Posts & Telecommun, Inst Data & Knowledge Engn, Nanjing, Jiangsu, Peoples R China

[2] Henan Univ, Inst Data & Knowledge Engn, Kaifeng, Henan, Peoples R China

来源：

2015 SEVENTH INTERNATIONAL SYMPOSIUM ON PARALLEL ARCHITECTURES, ALGORITHMS AND PROGRAMMING (PAAP) | 2015年

关键词：

Spark; Memory Computing; Spark SQL; MLlib; GraphX; Spark Streaming;

D O I：

10.1109/PAAP.2015.41

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Spark is a memory-based computing framework which has a better ability of computing and fault tolerance, supports batch, interactive, iterative and flow calculations. In this paper, we analyze the Spark's primary framework, core technologies, and point out the advantages and disadvantages of the Spark. In the end, we make a discussion for the future trends of the Spark technologies.

引用

页码：172 / 176

页数：5

共 27 条

[11] A STUDY OF HIGH-ORDER NON-GAUSSIANITY WITH APPLICATIONS TO MASSIVE CLUSTERS AND LARGE VOIDS [J].

Chongchitnan, Sirichai ;

Silk, Joseph .

ASTROPHYSICAL JOURNAL, 2010, 724 (01) :285-295

[12]

Conese A, 2015, INFERRING LATENT USE

[13]

Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137

[14] Equivalence of improvement in area under ROC curve and linear discriminant analysis coefficient under assumption of normality [J].

Demler, Olga V. ;

Pencina, Michael J. ;

D'Agostino, Ralph B. .

STATISTICS IN MEDICINE, 2011, 30 (12) :1410-1418

[15]

Franklin M., 2013, NIPS Machine Learning Open Source Software

[16]

Franzin-Garrec Martine, 2013, Soins, P1

[17] Evaluating Eyewitness Identification Procedures Using Receiver Operating Characteristic Analysis [J].

Gronlund, Scott D. ;

Wixted, John T. ;

Mickes, Laura .

CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 2014, 23 (01) :3-10

[18]

Hu MH, 2014, ASME PRESSURE VESSELS AND PIPING CONFERENCE - 2014, VOL 5

[19]

Lee Yunsou, 2015, International Journal of Contents, V11, P69

[20]

Okazaki Makoto, 2010, P 19 INT C WORLD WID, P851, DOI 10.1145/1772690.1772777

← 1 2 3 →