首页    期刊浏览 2024年08月22日 星期四
登录注册

文章基本信息

  • 标题:Squeezing a Big Orange into Little Boxes: The AscotDB System for Parallel Processing of Data on a Sphere
  • 本地全文:下载
  • 作者:Jacob Vanderplas ; Emad Soroush ; Simon Krughoff
  • 期刊名称:Bulletin of the Technical Committee on Data Engineering
  • 出版年度:2013
  • 卷号:36
  • 期号:4
  • 出版社:IEEE Computer Society
  • 摘要:AscotDB is a new, extensible data analysis system developed at the University of Washington for the interactive analysis of data from astronomical surveys. AscotDB is a layered system: It builds on SciDB to provide a shared-nothing, parallel array processing and data management engine. AscotDB wraps SciDB with a Python middleware that enables efficient storage and manipulation of spherical data, such as images from telescopes or satellites. The goal is to support the efficient storage of raw pixel-level data without any prior preprocessing steps. To enable both exploratory and deep analysis of the data, AscotDB's front-end design integrates a python interface with a graphical interface based on the Astronomy Collaborative Toolkit (ASCOT). AscotDB supports seamless switching between these two modes of interaction and captures a precise trace of a user's operations on the data to ensure repeatability. In this paper, we present an overview of the AscotDB system. While based on astronomy as its key application-domain, AscotDB primitives are general enough to be applicable to other scientific fields concerned with data on a sphere
国家哲学社会科学文献中心版权所有