Efficient & Accurate Scheduling Algorithm For Cloudera Hadoop

被引:1
|
作者
Yadav, Swati [1 ]
Vishwakarma, Santosh [1 ]
Verma, Ashok [1 ]
机构
[1] Gyan Ganga Inst Sci & Technol, Dept Comp Sci, Jabalpur, India
来源
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN) | 2015年
关键词
MapReduce; huge Data; Hadoop; Cloud Computing; Improved Scheduling;
D O I
10.1109/CICN.2015.322
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
the term immense data was coined to capture which suggests of this rising trend. To boot to its sheer volume, immense data to boot exhibits completely different distinctive characteristics as compared with ancient data. For instance, immense data is typically unstructured and wish extra amount analysis. This development incorporates new system architectures for data acquisition, transmission, storage, and large-scale process mechanisms. Recent technological advancements have semiconductor diode to a deluge of information from distinctive domains (e.g., health care and sciatic sensors, user generated data, net and money corporations, and supply chain systems). the buildup of information over the past twenty years has enlarged to large volumes. Apache Hadoop have introduced a economical and possible tool for distributed computing of such immense data for filtering and extracting massive volumes of knowledge. MapReduce can be a good used parallel computing framework for giant scale process. The two major performance metrics in MapReduce area unit job execution time and cluster production. MapReduce uses inventory accounting job programming by default and completely different programming algorithms area unit being introduced in proprietary domain. This work introduces a metric primarily based programming algorithmic rule to reinforce the potency and utilization of the server resources.
引用
收藏
页码:839 / 844
页数:6
相关论文
共 50 条
  • [11] Maximum Satisfaction Scheduling algorithm Based on Hadoop Architecture
    Chen Kuan-ting
    Huang Jian-hua
    Yi, Jin
    Xi, He
    PROCEEDINGS OF THE 2016 2ND WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS, 2016, 81 : 1787 - 1793
  • [12] New Scheduling Algorithm in Hadoop Based on Resource Aware
    Xu, Peng
    Wang, Hong
    Tian, Ming
    PRACTICAL APPLICATIONS OF INTELLIGENT SYSTEMS, ISKE 2013, 2014, 279 : 1011 - 1020
  • [13] Load balancing task scheduling algorithm in Hadoop platform
    Cai Yandong
    Liu Yan
    Zhang Qinglei
    2015 SEVENTH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2015), 2015, : 605 - 608
  • [14] Deadline scheduling algorithm for sustainable computing in Hadoop environment
    Varga, Mihai
    Petrescu-Nita, Alina
    Pop, Florin
    COMPUTERS & SECURITY, 2018, 76 : 354 - 366
  • [15] Application of Improved Artificial Bee Colony Algorithm in Hadoop Scheduling Algorithm
    Wang, S. Z.
    Zhao, S. C.
    Zhou, H. W.
    2015 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND TECHNOLOGY (ICCST 2015), 2015, : 111 - 115
  • [17] Hadoop-MCC: Efficient Multiple Compound Comparison Algorithm Using Hadoop
    Hua, Guan-Jie
    Hung, Che-Lun
    Tang, Chuan Yi
    COMBINATORIAL CHEMISTRY & HIGH THROUGHPUT SCREENING, 2018, 21 (02) : 84 - 92
  • [18] A weighted value scheduling algorithm based on Hadoop computer platform
    Liu, Feng
    Zhou, Wengang
    Zhao, Yang
    Metallurgical and Mining Industry, 2015, 7 (04): : 268 - 273
  • [19] FRESH: Fair and Efficient Slot Configuration and Scheduling for Hadoop Clusters
    Wang, Jiayin
    Yao, Yi
    Mao, Ying
    Sheng, Bo
    Mi, Ningfang
    2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 761 - 768
  • [20] Profit-oriented task scheduling algorithm in Hadoop cluster
    Chai, Xu-qing
    Dong, Yong-liang
    Li, Jun-fei
    EURASIP JOURNAL ON EMBEDDED SYSTEMS, 2016,