Efficient & Accurate Scheduling Algorithm For Cloudera Hadoop

被引:1
|
作者
Yadav, Swati [1 ]
Vishwakarma, Santosh [1 ]
Verma, Ashok [1 ]
机构
[1] Gyan Ganga Inst Sci & Technol, Dept Comp Sci, Jabalpur, India
来源
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN) | 2015年
关键词
MapReduce; huge Data; Hadoop; Cloud Computing; Improved Scheduling;
D O I
10.1109/CICN.2015.322
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
the term immense data was coined to capture which suggests of this rising trend. To boot to its sheer volume, immense data to boot exhibits completely different distinctive characteristics as compared with ancient data. For instance, immense data is typically unstructured and wish extra amount analysis. This development incorporates new system architectures for data acquisition, transmission, storage, and large-scale process mechanisms. Recent technological advancements have semiconductor diode to a deluge of information from distinctive domains (e.g., health care and sciatic sensors, user generated data, net and money corporations, and supply chain systems). the buildup of information over the past twenty years has enlarged to large volumes. Apache Hadoop have introduced a economical and possible tool for distributed computing of such immense data for filtering and extracting massive volumes of knowledge. MapReduce can be a good used parallel computing framework for giant scale process. The two major performance metrics in MapReduce area unit job execution time and cluster production. MapReduce uses inventory accounting job programming by default and completely different programming algorithms area unit being introduced in proprietary domain. This work introduces a metric primarily based programming algorithmic rule to reinforce the potency and utilization of the server resources.
引用
收藏
页码:839 / 844
页数:6
相关论文
共 50 条
  • [1] Tolhit - A Scheduling Algorithm for Hadoop Cluster
    Brahmwar, M.
    Kumar, M.
    Sikka, G.
    TWELFTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2016 / TWELFTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2016 / TWELFTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2016, 2016, 89 : 203 - 208
  • [2] A Task Scheduling Algorithm for Hadoop Platform
    Chen, Jilan
    Wang, Dan
    Zhao, Wenbing
    JOURNAL OF COMPUTERS, 2013, 8 (04) : 929 - 936
  • [3] Research on job scheduling algorithm in Hadoop
    Xia, Yang
    Wang, Lei
    Zhao, Qiang
    Zhang, Gongxuan
    Journal of Computational Information Systems, 2011, 7 (16): : 5769 - 5775
  • [4] Improving the efficiency of MapReduce scheduling algorithm in Hadoop
    Thangaselvi, R.
    Ananthbabu, S.
    Jagadeesh, S.
    Aruna, R.
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL COMPUTING AND COMMUNICATION TECHNOLOGY (ICATCCT), 2015, : 63 - 68
  • [5] A New Scheduling Algorithm in Hadoop Map Reduce
    Peng, Zhiping
    Ma, Yanchun
    EMERGING RESEARCH IN ARTIFICIAL INTELLIGENCE AND COMPUTATIONAL INTELLIGENCE, 2011, 237 : 537 - +
  • [6] An Adaptive Scheduling Algorithm for Heterogeneous Hadoop Systems
    Han, Jiazhen
    Yuan, Zhengheng
    Han, Yiheng
    Peng, Cheng
    Liu, Jing
    Li, Guangli
    2017 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2017), 2017, : 845 - 850
  • [7] Performance evaluation sql-on-hadoop: a case study of Hortonworks and Cloudera
    Ronianto, M. Faridh
    Asror, Ibnu
    Prabowo, Sidik
    Nugraha, Fajar Arief
    2ND INTERNATIONAL CONFERENCE ON DATA AND INFORMATION SCIENCE, 2019, 1192
  • [8] HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
    Gandomi, Abolfazl
    Reshadi, Midia
    Movaghar, Ali
    Khademzadeh, Ahmad
    JOURNAL OF BIG DATA, 2019, 6 (01)
  • [9] HybSMRP: a hybrid scheduling algorithm in Hadoop MapReduce framework
    Abolfazl Gandomi
    Midia Reshadi
    Ali Movaghar
    Ahmad Khademzadeh
    Journal of Big Data, 6
  • [10] DYNAMIC SCHEDULING ALGORITHM FOR REDUCING START TIME IN HADOOP
    Gunasekaran, S.
    SaiRamesh, L.
    Sabena, S.
    Selvakumar, K.
    Ganapathy, S.
    Kannan, A.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INFORMATICS AND ANALYTICS (ICIA' 16), 2016,