首页    期刊浏览 2024年11月27日 星期三
登录注册

文章基本信息

  • 标题:An Extended Two-Phase Method for Accessing Sections of Out-of-Core Arrays
  • 本地全文:下载
  • 作者:Rajeev Thakur ; Alok Choudhary
  • 期刊名称:Scientific Programming
  • 印刷版ISSN:1058-9244
  • 出版年度:1996
  • 卷号:5
  • 期号:4
  • 页码:301-317
  • DOI:10.1155/1996/547186
  • 出版社:Hindawi Publishing Corporation
  • 摘要:

    A number of applications on parallel computers deal with very large data sets that cannot fit in main memory. In such applications, data must be stored in files on disks and fetched into memory during program execution. Parallel programs with large out-of-core arrays stored in files must read/write smaller sections of the arrays from/to files. In this article, we describe a method for accessing sections of out-of-core arrays efficiently. Our method, the extended two-phase method, uses collective l/O: Processors cooperate to combine several l/O requests into fewer larger granularity requests, to reorder requests so that the file is accessed in proper sequence, and to eliminate simultaneous l/O requests for the same data. In addition, the l/O workload is divided among processors dynamically, depending on the access requests. We present performance results obtained from two real out-of-core parallel applications – matrix multiplication and a Laplace's equation solver – and several synthetic access patterns, all on the Intel Touchstone Delta. These results indicate that the extended two-phase method significantly outperformed a direct (noncollective) method for accessing out-of-core array sections.

国家哲学社会科学文献中心版权所有