首页    期刊浏览 2024年07月16日 星期二
登录注册

文章基本信息

  • 标题:Redundant Data Removal Technique for Efficient Big Data Search Processing
  • 本地全文:下载
  • 作者:Seungwoo Jeon ; Bonghee Hong ; Joonho Kwon
  • 期刊名称:International Journal of Software Engineering and Its Applications
  • 印刷版ISSN:1738-9984
  • 出版年度:2013
  • 卷号:7
  • 期号:4
  • 出版社:SERSC
  • 摘要:Ranch industry has grown bigger. In Australia, ranches have very large number of live-stock commodities: cattle, lambs, and muttons. To manage such a very large scale commodi-ties, they need to install sensor network with MapReduce of Hadoop; since the sensor net-work generates a huge amount of data. The ranch is divided into several patterned regions and a lot of hubs are installed in there for retrieving the sensor data. However, when the sen-sor moves to an overlapped area among some hubs, the sensor data are transmitted to all hubs covering the area. Obviously, these data is redundant. Therefore, we propose removal technique to delete the redundant data and to efficiently process the data on the map phase. In order to detect redundancy, the data will be compared using some parameters, and then the detected redundant data will be deleted according to some rules
  • 关键词:Hadoop; MapReduce; Duplicate data; Removal technique
国家哲学社会科学文献中心版权所有