首页    期刊浏览 2025年07月28日 星期一
登录注册

文章基本信息

  • 标题:Scalable Strategies for Computing with Massive Data
  • 本地全文:下载
  • 作者:Michael Kane ; John W. Emerson ; Stephen Weston
  • 期刊名称:Journal of Statistical Software
  • 印刷版ISSN:1548-7660
  • 电子版ISSN:1548-7660
  • 出版年度:2013
  • 卷号:55
  • 期号:1
  • 页码:1-19
  • 语种:English
  • 出版社:University of California, Los Angeles
  • 摘要:This paper presents two complementary statistical computing frameworks that address challenges in parallel processing and the analysis of massive data. First, the foreach package allows users of the R programming environment to define parallel loops that may be run sequentially on a single machine, in parallel on a symmetric multiprocessing (SMP) machine, or in cluster environments without platform-specific code. Second, the bigmemory package implements memory- and file-mapped data structures that provide (a) access to arbitrarily large data while retaining a look and feel that is familiar to R users and (b) data structures that are shared across processor cores in order to support efficient parallel computing techniques. Although these packages may be used independently, this paper shows how they can be used in combination to address challenges that have effectively been beyond the reach of researchers who lack specialized software development skills or expensive hardware.
国家哲学社会科学文献中心版权所有