首页    期刊浏览 2024年12月03日 星期二
登录注册

文章基本信息

  • 标题:Empirical Study of Job Scheduling Algorithms in Hadoop MapReduce
  • 本地全文:下载
  • 作者:Jyoti V. Gautam ; Harshadkumar B. Prajapati ; Vipul K. Dabhi
  • 期刊名称:Cybernetics and Information Technologies
  • 印刷版ISSN:1311-9702
  • 电子版ISSN:1314-4081
  • 出版年度:2017
  • 卷号:17
  • 期号:1
  • 页码:146
  • 出版社:Bulgarian Academy of Science
  • 摘要:Several Job scheduling algorithms have been developed for Hadoop - MapReduce model, which vary widely in design and behavior for handling different issues such as locality of data, user share fairness, and resource awareness. This article focuses on empirica lly evaluating the performance of three schedulers : First I n First Out ( FIFO ) , Fair scheduler, and Capacity scheduler. To carry out the experimental evaluation, we implement our own Hadoop cluster testbed, consisting of four machines, in which one of the m achines works as the master node and all four machines work as slave nodes. The experiments include variation in data sizes, use of two different data processing applications, and variation in the number of nodes used in processing. The article analyzes th e performance of the job scheduling algorithms based on various relevant performance measures. The results of the experiments are evident of the performance being affected by the job scheduling parameters, the type of applications, the number of nodes in t he cluster, and size of the input data.
  • 关键词:Big ; D ; ata ; ; ; ; Hadoop ; ; ; ; MapReduce ; ; ; ; job scheduling ; ; ; ; analysis ; ; ; ; experimental ; evaluation
国家哲学社会科学文献中心版权所有