首页    期刊浏览 2025年08月08日 星期五
登录注册

文章基本信息

  • 标题:Review on Data merging and Data movement to accelerate Hadoop performance
  • 本地全文:下载
  • 作者:Kishor Shinde ; Prof. Venkateshan N
  • 期刊名称:International Journal of Engineering and Computer Science
  • 印刷版ISSN:2319-7242
  • 出版年度:2014
  • 卷号:3
  • 期号:12
  • 页码:9510-9512
  • 出版社:IJECS
  • 摘要:Hadoop is popular framework for storing and processing big data in cloud computing. Map-Reduce and HDFSare the two major components of Hadoop. Map reduce is programming model for Hadoop and HDFS is a Hadoopdistributed file system which is mainly used as storage component for Hadoop framework. Existing Hadoop system hasmany performance issues like serialization barrier, repetitive merges, portability issues for different interconnects. Aneffective and efficient I/O capability is also required for Hadoop. As data size is increasing day by day the performance ofHadoop is becoming a critical issue. To handle large dataset needs to improve the performance by modifying existingHadoop system. The network levitated merge algorithm is used to avoid repetitive merges. A full pipeline is designed tooverlap the Hadoop shuffle merge and reduce phase. Hadoop-A i.e. Hadoop Acceleration framework overcomes theportability issue for different interconnects. It also speeds up data movement and also reduces the disk access
  • 关键词:Hadoop; HDFS; Cloud Computing
国家哲学社会科学文献中心版权所有