AMPO: Algorithm for MapReduce Performance Optimization for Enhancing Big Data Analytics

被引:0
|
作者
Yambem, Nandita [1 ]
Nandakumar, A. N. [2 ]
机构
[1] Vemana IT, ISE Dept, VTU RRC, Bangalore, Karnataka, India
[2] GSSSIETW, Dept CSE, Mysuru, Karnataka, India
来源
2017 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, COMMUNICATION, COMPUTER, AND OPTIMIZATION TECHNIQUES (ICEECCOT) | 2017年
关键词
Hadoop; Map Reduce; Optimization; Big Data Analytics; Cloud;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The usage of cloud computing has lead to generation of petabytes of data just in a matter of second, which required a pivotal attention for analysis along with the storage. Although, storage issues in cloud has been solved to a large extent, but performing distributed analytical operation over the cloud is still a bigger challenge. The frequently used Hadoop MapReduce can perform distributed process modeling and inspite of its advantages, its pitfalls overshadow its potential advantageous features in terms of optimization. Hence, this paper presents a technique called as Algorithm for MapReduce Performance Optimization or AMPO for enhancing the performance of big data analytics. An analytical research methodology was adopted considering a case study of larger size traffic data to find that AMPO offers faster response time and lowered cost of resources as compared to the conventional MapReduce Programs without eliminating its major mapping and reducer operations.
引用
收藏
页码:717 / 723
页数:7
相关论文
共 50 条
  • [21] Challenges for MapReduce in Big Data
    Grolinger, Katarina
    Hayes, Michael
    Higashino, Wilson A.
    L'Heureux, Alexandra
    Allison, David S.
    Capretz, Miriam A. M.
    2014 IEEE WORLD CONGRESS ON SERVICES (SERVICES), 2014, : 182 - 189
  • [22] A Top-k Query Algorithm for Big Data Based on MapReduce
    Lin, Xueyan
    PROCEEDINGS OF 2015 6TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE, 2015, : 982 - 985
  • [23] A Crowdsourcing Worker Quality Evaluation Algorithm on MapReduce for Big Data Applications
    Dang, Depeng
    Liu, Ying
    Zhang, Xiaoran
    Huang, Shihang
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2016, 27 (07) : 1879 - 1888
  • [24] Big Data Prediction Framework for Weather Temperature Based on MapReduce Algorithm
    Ismail, Khalid Adam
    Majid, Mazlina Abdul
    Zain, Jasni Mohamed
    Abu Bakar, Noor Akma
    2016 IEEE CONFERENCE ON OPEN SYSTEMS, 2016, : 13 - 17
  • [25] A genetic algorithm-based job scheduling model for big data analytics
    Lu, Qinghua
    Li, Shanshan
    Zhang, Weishan
    Zhang, Lei
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2016,
  • [26] Genetic Algorithm based Job Scheduling for Big Data Analytics
    Lu, Qinghua
    Li, Shanshan
    Zhang, Weishan
    2015 INTERNATIONAL CONFERENCE ON IDENTIFICATION, INFORMATION, AND KNOWLEDGE IN THE INTERNET OF THINGS (IIKI), 2015, : 33 - 38
  • [27] Enhancing Dependability in Big Data Analytics Enterprise Pipelines
    Zahid, Hira
    Mahmood, Tariq
    Ikram, Nassar
    SECURITY, PRIVACY, AND ANONYMITY IN COMPUTATION, COMMUNICATION, AND STORAGE (SPACCS 2018), 2018, 11342 : 272 - 281
  • [28] Big Data Analytics Services for Enhancing Business Intelligence
    Sun, Zhaohao
    Sun, Lizhe
    Strang, Kenneth
    JOURNAL OF COMPUTER INFORMATION SYSTEMS, 2018, 58 (02) : 162 - 169
  • [29] Big Data Analytics
    Rajaraman, V.
    RESONANCE-JOURNAL OF SCIENCE EDUCATION, 2016, 21 (08): : 695 - 716
  • [30] A Performance Analysis of MapReduce Applications on Big Data in Cloud based Hadoop
    Gohil, Parth
    Garg, Dweepna
    Panchal, Bakul
    2014 INTERNATIONAL CONFERENCE ON INFORMATION COMMUNICATION AND EMBEDDED SYSTEMS (ICICES), 2014,