首页    期刊浏览 2024年07月06日 星期六
登录注册

文章基本信息

  • 标题:Research on Reliability of Hadoop Distributed File System
  • 本地全文:下载
  • 作者:Daming Hu ; Deyun Chen ; Shuhui Lou
  • 期刊名称:International Journal of Multimedia and Ubiquitous Engineering
  • 印刷版ISSN:1975-0080
  • 出版年度:2015
  • 卷号:10
  • 期号:11
  • 页码:315-326
  • DOI:10.14257/ijmue.2015.10.11.30
  • 出版社:SERSC
  • 摘要:With the development of cloud computing, more and more enterprises begin to develop their own cloud storage architecture by Hadoop. HDFS, at the bottom of Hadoop framework, stores files on all the nodes in cluster. This article first analyzed the HDFS architecture and put forward a problem single point of failure: There is only one NameNode in HDFS, which has limited the number of metadata storage and is prone to a failure of single node. Once the NameNode fault occurs, the system will break down. It affects the reliability of the cluster directly. Then it introduced Paxos algorithm and improved the structure of HDFS according to its principle. It solved the problem by increasing the number of NameNode and ensuring the synchronization of them by Paxos algorithm. At last, it verified the feasibility of the scheme by an experiment. A failure of metadata server will not interrupt the system so the reliability is improved.
  • 关键词:cloud computing; Paxos algorithm; failure of single node; HDFS; reliability
国家哲学社会科学文献中心版权所有