Development of Multiple Big Data Analytics Platforms with Rapid Response

被引:2
作者
Chang, Bao Rong [1 ]
Lee, Yun-Da [1 ]
Liao, Po-Hao [1 ]
机构
[1] Natl Univ Kaohsiung, Dept Comp Sci & Informat Engn, 700 Kaohsiung Univ Rd, Kaohsiung 811, Taiwan
关键词
BUSINESS INTELLIGENCE;
D O I
10.1155/2017/6972461
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The crucial problem of the integration of multiple platforms is how to adapt for their own computing features so as to execute the assignments most efficiently and gain the best outcome. This paper introduced the new approaches to big data platform, RHhadoop and SparkR, and integrated them to form a high-performance big data analytics with multiple platforms as part of business intelligence (BI) to carry out rapid data retrieval and analytics with R programming. This paper aims to develop the optimization for job scheduling using MSHEFT algorithm and implement the optimized platform selection based on computing features for improving the system throughput significantly. In addition, users would simply give R commands rather than run Java or Scala programto perform the data retrieval and analytics in the proposed platforms. As a result, according to performance index calculated for various methods, although the optimized platform selection can reduce the execution time for the data retrieval and analytics significantly, furthermore scheduling optimization definitely increases the system efficiency a lot.
引用
收藏
页数:13
相关论文
共 25 条
  • [1] Adnan M, 2014, 2014 11TH ANNUAL HIGH CAPACITY OPTICAL NETWORKS AND EMERGING/ENABLING TECHNOLOGIES (PHOTONICS FOR ENERGY), P99, DOI 10.1109/HONET.2014.7029370
  • [2] [Anonymous], 2010, HOTCLOUD
  • [3] [Anonymous], INT J COMPUTATIONAL
  • [4] [Anonymous], 2012, Login: The Usenix Magazine
  • [5] [Anonymous], 2015, INT J INNOVATIVE RES
  • [6] Aravinth S.S., 2015, IJIRST -International Journal for Innovative Research in Science Technology, V1, P252
  • [7] Chang B.-R., 2016, J INFORM HIDING MULT, V7, P80
  • [8] Chang B. R., 2014, J INFORM HIDING MULT, V5, P614
  • [9] Chang B. R., 2016, J INFORM HIDING MULT, V7, P993
  • [10] Empirical Analysis of Cloud-Mobile Computing Based VVoIP with Intelligent Adaptation
    Chang, Bao Rong
    Tsai, Hsiu-Fen
    Chen, Chi-Ming
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2016, 17 (05): : 993 - 1002