首页    期刊浏览 2024年11月24日 星期日
登录注册

文章基本信息

  • 标题:An Improved Hadoop Data Load Balancing Algorithm
  • 本地全文:下载
  • 作者:Liu, Kun ; Xu, Gaochao ; Yuan, Jun’e
  • 期刊名称:Journal of Networks
  • 印刷版ISSN:1796-2056
  • 出版年度:2013
  • 卷号:8
  • 期号:12
  • 页码:2816-2822
  • DOI:10.4304/jnw.8.12.2816-2822
  • 语种:English
  • 出版社:Academy Publisher
  • 摘要:Data load balancing is one of the key problems of big data technology. As a big data application, Hadoop has had many successful applications. HDFS is Hadoop Distributed File System and has the load balancing procedure which can balance the storage load on each machine. However, this method cannot balance the overload rack preferentially, and so it is likely to cause the breakdown of overload machines. In this paper, we focus on the overload machines and propose an improved algorithm for balancing the overload racks preferentially. The improved method constructs Prior Balance List list which includes overload machines, For Balance List list and NextForBalanceList list by many factors and balances among the racks selected from these lists firstly. Experiments show that the improved method can balance the overload racks in time and reduce the possibility of breakdown of these racks
  • 关键词:Hadoop;Load Balancing;Overload;HDFS;Big Data
国家哲学社会科学文献中心版权所有