AMPO: Algorithm for MapReduce Performance Optimization for Enhancing Big Data Analytics

被引:0
作者
Yambem, Nandita [1 ]
Nandakumar, A. N. [2 ]
机构
[1] Vemana IT, ISE Dept, VTU RRC, Bangalore, Karnataka, India
[2] GSSSIETW, Dept CSE, Mysuru, Karnataka, India
来源
2017 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, COMMUNICATION, COMPUTER, AND OPTIMIZATION TECHNIQUES (ICEECCOT) | 2017年
关键词
Hadoop; Map Reduce; Optimization; Big Data Analytics; Cloud;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The usage of cloud computing has lead to generation of petabytes of data just in a matter of second, which required a pivotal attention for analysis along with the storage. Although, storage issues in cloud has been solved to a large extent, but performing distributed analytical operation over the cloud is still a bigger challenge. The frequently used Hadoop MapReduce can perform distributed process modeling and inspite of its advantages, its pitfalls overshadow its potential advantageous features in terms of optimization. Hence, this paper presents a technique called as Algorithm for MapReduce Performance Optimization or AMPO for enhancing the performance of big data analytics. An analytical research methodology was adopted considering a case study of larger size traffic data to find that AMPO offers faster response time and lowered cost of resources as compared to the conventional MapReduce Programs without eliminating its major mapping and reducer operations.
引用
收藏
页码:717 / 723
页数:7
相关论文
共 50 条
  • [41] Prominence of MapReduce in BIG DATA Processing
    Pandey, Shweta
    Tokekar, Vrinda
    [J]. 2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, : 555 - 560
  • [42] PARALLEL KNOWLEDGE ACQUISITION ALGORITHM FOR BIG DATA USING MAPREDUCE
    Qian, Jin
    Xia, Min
    Lv, Ping
    [J]. PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOL. 1, 2015, : 316 - 321
  • [43] Incremental attribute reduction algorithm for big data using MapReduce
    Lv, Ping
    Qian, Jin
    Yue, Xiaodong
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2016, 16 (03) : 641 - 652
  • [44] Optimization Driven MapReduce Framework for Indexing and Retrieval of Big Data
    Abdalla, Hemn Barzan
    Ahmed, Awder Mohammed
    Al Sibahee, M. A.
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (05): : 1886 - 1908
  • [45] The optimization for recurring queries in big data analysis system with MapReduce
    Zhang, Bin
    Wang, Xiaoyang
    Zheng, Zhigao
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 : 549 - 556
  • [46] Moving Hadoop to the Cloud for Big Data Analytics
    Astrova, Irina
    Koschel, Arne
    Heine, Felix
    Kalja, Ahto
    [J]. DATABASES AND INFORMATION SYSTEMS X (DB&IS 2018), 2019, 315 : 195 - 209
  • [47] Performance optimization of MapReduce-based Apriori algorithm on Hadoop cluster
    Singh, Sudhakar
    Garg, Rakhi
    Mishra, P. K.
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2018, 67 : 348 - 364
  • [48] Autonomic deployment decision making for big data analytics applications in the cloud
    Lu, Qinghua
    Li, Zheng
    Zhang, Weishan
    Yang, Laurence T.
    [J]. SOFT COMPUTING, 2017, 21 (16) : 4501 - 4512
  • [49] Performance Evaluation of Big Data Frameworks for Large-Scale Data Analytics
    Veiga, Jorge
    Exposito, Roberto R.
    Pardo, Xoan C.
    Taboada, Guillermo L.
    Tourino, Juan
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2016, : 424 - 431
  • [50] High-Performance Geospatial Big Data Processing System Based on MapReduce
    Jo, Junghee
    Lee, Kang-Woo
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (10):