AMPO: Algorithm for MapReduce Performance Optimization for Enhancing Big Data Analytics

被引:0
|
作者
Yambem, Nandita [1 ]
Nandakumar, A. N. [2 ]
机构
[1] Vemana IT, ISE Dept, VTU RRC, Bangalore, Karnataka, India
[2] GSSSIETW, Dept CSE, Mysuru, Karnataka, India
来源
2017 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, COMMUNICATION, COMPUTER, AND OPTIMIZATION TECHNIQUES (ICEECCOT) | 2017年
关键词
Hadoop; Map Reduce; Optimization; Big Data Analytics; Cloud;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The usage of cloud computing has lead to generation of petabytes of data just in a matter of second, which required a pivotal attention for analysis along with the storage. Although, storage issues in cloud has been solved to a large extent, but performing distributed analytical operation over the cloud is still a bigger challenge. The frequently used Hadoop MapReduce can perform distributed process modeling and inspite of its advantages, its pitfalls overshadow its potential advantageous features in terms of optimization. Hence, this paper presents a technique called as Algorithm for MapReduce Performance Optimization or AMPO for enhancing the performance of big data analytics. An analytical research methodology was adopted considering a case study of larger size traffic data to find that AMPO offers faster response time and lowered cost of resources as compared to the conventional MapReduce Programs without eliminating its major mapping and reducer operations.
引用
收藏
页码:717 / 723
页数:7
相关论文
共 50 条
  • [1] The Performance Optimization of Big Data Processing by Adaptive MapReduce Workflow
    Li, Wei
    Tang, Maolin
    IEEE ACCESS, 2022, 10 : 79004 - 79020
  • [2] An Enhanced Memetic Algorithm for Feature Selection in Big Data Analytics with MapReduce
    Ramakrishnan, Umanesan
    Nachimuthu, Nandhagopal
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2022, 31 (03) : 1547 - 1559
  • [3] A Hadoop/MapReduce based platform for supporting health big data analytics
    Kuo A.
    Chrimes D.
    Qin P.
    Zamani H.
    Studies in Health Technology and Informatics, 2019, 257 : 229 - 235
  • [4] Big Data Analytics Framework for Childhood Infectious Disease Surveillance and Response System using Modified MapReduce Algorithm
    Mwamnyange, Mdoe
    Luhanga, Edith
    Thodge, Sanket R.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (03) : 373 - 385
  • [5] Optimization and Application in Medical Big Document-Data of Apriori Algorithm based on MapReduce
    Li Wei
    Liu Guangming
    Shao Yachao
    Liu Junlong
    Zuo You
    2016 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI), 2016,
  • [6] Enabling Big Data Analytics in the Hybrid Cloud using Iterative MapReduce
    Clemente-Castello, Francisco J.
    Nicolae, Bogdan
    Katrinis, Kostas
    Rafique, M. Mustafa
    Mayo, Rafael
    Carlos Fernandez, Juan
    Loreti, Daniela
    2015 IEEE/ACM 8TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC), 2015, : 290 - 299
  • [7] Big Data Analytics: Performance Evaluation for High Availability and Fault Tolerance using MapReduce Framework with HDFS
    Verma, Jai Prakash
    Mankad, Sapan H.
    Garg, Sanjay
    2018 FIFTH INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (IEEE PDGC), 2018, : 770 - 775
  • [8] Toward Conceptual MapReduce Algorithm for Big Data Platfrom
    Sohn, Seungdae
    Kim, Jinhong
    2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 985 - 988
  • [9] Big Data: Tutorial and guidelines on information and process fusion for analytics algorithms with MapReduce
    Ramirez-Gallego, Sergio
    Fernandez, Alberto
    Garcia, Salvador
    Chen, Min
    Herrera, Francisco
    INFORMATION FUSION, 2018, 42 : 51 - 61
  • [10] Performance Evaluation of Big Data Frameworks: MapReduce and Spark
    Singh, Jaspreet
    Panda, S. N.
    Kaushal, Rajesh
    INTELLIGENT COMMUNICATION, CONTROL AND DEVICES, ICICCD 2017, 2018, 624 : 1611 - 1619