Efficient & Accurate Scheduling Algorithm For Cloudera Hadoop

被引:1
作者
Yadav, Swati [1 ]
Vishwakarma, Santosh [1 ]
Verma, Ashok [1 ]
机构
[1] Gyan Ganga Inst Sci & Technol, Dept Comp Sci, Jabalpur, India
来源
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN) | 2015年
关键词
MapReduce; huge Data; Hadoop; Cloud Computing; Improved Scheduling;
D O I
10.1109/CICN.2015.322
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
the term immense data was coined to capture which suggests of this rising trend. To boot to its sheer volume, immense data to boot exhibits completely different distinctive characteristics as compared with ancient data. For instance, immense data is typically unstructured and wish extra amount analysis. This development incorporates new system architectures for data acquisition, transmission, storage, and large-scale process mechanisms. Recent technological advancements have semiconductor diode to a deluge of information from distinctive domains (e.g., health care and sciatic sensors, user generated data, net and money corporations, and supply chain systems). the buildup of information over the past twenty years has enlarged to large volumes. Apache Hadoop have introduced a economical and possible tool for distributed computing of such immense data for filtering and extracting massive volumes of knowledge. MapReduce can be a good used parallel computing framework for giant scale process. The two major performance metrics in MapReduce area unit job execution time and cluster production. MapReduce uses inventory accounting job programming by default and completely different programming algorithms area unit being introduced in proprietary domain. This work introduces a metric primarily based programming algorithmic rule to reinforce the potency and utilization of the server resources.
引用
收藏
页码:839 / 844
页数:6
相关论文
共 50 条
[31]   Adaptive Scheduling in the Cloud - SLA for Hadoop Job Scheduling [J].
Nayak, Deveeshree ;
Martha, Venkata Swamy ;
Threm, David ;
Ramaswamy, Srini ;
Prince, Summer ;
Fahrnberger, Guenter .
2015 SCIENCE AND INFORMATION CONFERENCE (SAI), 2015, :832-837
[32]   Study of an improved hadoop speculative execution algorithm [J].
Wang, Baoyi ;
Pu, Xiaoyang ;
Zhang, Shaomin .
APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 :2281-2284
[33]   Locality Premised Reducer Scheduling in Hadoop [J].
Fatma, Nusrat ;
Singh, Remant Kr. ;
Ahmad, Shafeeq ;
Srivastava, Prachi .
PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON SYSTEM MODELING & ADVANCEMENT IN RESEARCH TRENDS (SMART-2016), 2016, :222-224
[34]   TaskTracker Aware Scheduling for Hadoop MapReduce [J].
Manjaly, Jisha S. ;
Chooralil, Varghese S. .
2013 THIRD INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING AND COMMUNICATIONS (ICACC 2013), 2013, :278-281
[35]   A REVIEW ON JOB SCHEDULING FOR HADOOP MAPREDUCE [J].
Kalia, Khushboo ;
Gupta, Neeraj .
2017 INTERNATIONAL CONFERENCE ON NEXT GENERATION COMPUTING AND INFORMATION SYSTEMS (ICNGCIS), 2017, :75-79
[36]   Secure & Optimize Hadoop scheduling using AMF-H3 Framework with Bat Algorithm [J].
Kaur, Sukhwinder ;
Gangwar, R. C. ;
Kahlon, Gagandeep Singh .
2017 CONFERENCE ON EMERGING DEVICES AND SMART SYSTEMS (ICEDSS), 2017, :205-208
[37]   Research of Improved Particle Swarm Optimization Based on Genetic Algorithm for Hadoop Task Scheduling Problem [J].
Xu, Jun ;
Tang, Yong .
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2015, 2015, 9532 :829-834
[38]   Improved Adaptive Feedback Scheduling Algorithm based on LATE in Hadoop Platform [J].
Guo, Jing ;
Wang, Yong .
PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, :4033-4038
[39]   Adaptive Scheduling Algorithm for Hadoop Node Capability in Heterogeneous Resource Environment [J].
Zheng, Ming ;
Zhuo, Mugui .
CYBER SECURITY INTELLIGENCE AND ANALYTICS, 2020, 928 :1332-1336
[40]   Self-learning dynamic adjustment scheduling algorithm based on Hadoop [J].
Li, Fucong ;
Li, Zhuyu ;
Chen, Guohui ;
Li, Xiangxin .
PROCEEDINGS OF THE 2015 3RD INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS, 2015, 35 :314-318