首页    期刊浏览 2025年02月26日 星期三
登录注册

文章基本信息

  • 标题:A New MapReduce Framework Based on Virtual IP Mechanism and Load Balancing Strategy
  • 本地全文:下载
  • 作者:Song Yang ; Hao Pingting ; Hu Jiejun
  • 期刊名称:The Open Cybernetics & Systemics Journal
  • 电子版ISSN:1874-110X
  • 出版年度:2015
  • 卷号:9
  • 期号:1
  • 页码:253-261
  • DOI:10.2174/1874110X01509010253
  • 出版社:Bentham Science Publishers Ltd
  • 摘要:

    MapReduce is an important method for large-scale data processing on parallel architecture. In Hadoop ecosystem, MapReduce runs on the application-level, thus it provides system with flexibility. MapReduce is good at offline batch processing and it could accelerate the whole execution time. The deficiency of the MapReduce architecture is a lack in balancing and scalability, thus leads to low efficiency when dealing with large-scale data. In this paper, we propose a new MapReduce framework that is more suitable for Hadoop ecosystem. The framework is based on the virtual IP mechanism and load balancing strategy. Comparative experiments indicate that the new framework achieve twice the performance compared to the original MapReduce. Besides, the framework fully meets the environment of Hadoop ecosystem, and provides a stable and efficient data processing.

国家哲学社会科学文献中心版权所有