首页    期刊浏览 2024年11月27日 星期三
登录注册

文章基本信息

  • 标题:PARALLEL CREATION OF VARIO-SCALE DATA STRUCTURES FOR LARGE DATASETS
  • 本地全文:下载
  • 作者:M. Meijers ; R. Šuba ; P. van Oosterom
  • 期刊名称:ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
  • 印刷版ISSN:2194-9042
  • 电子版ISSN:2194-9050
  • 出版年度:2015
  • 卷号:XL-4/W7
  • 页码:1-9
  • DOI:10.5194/isprsarchives-XL-4-W7-1-2015
  • 出版社:Copernicus Publications
  • 摘要:Processing massive datasets which are not fitting in the main memory of computer is challenging. This is especially true in the case of map generalization, where the relationships between (nearby) features in the map must be considered. In our case, an automated map generalization process runs offline to produce a dataset suitable for visualizing at arbitrary map scale (vario-scale) and efficiently enabling smooth zoom user interactions over the web. Our solution to be able to generalize such large vector datasets is based on the idea of subdividing the workload according to the Fieldtree organization: a multi-level structure of space. It subdivides space regularly into fields (grid cells), at every level with shifted origin. Only features completely fitting within a field are processed. Due to the Fieldtree organization, features on the boundary at a given level will be contained completely in one of the fields of the higher levels. Every field that resides at the same level in the Fieldtree can be processed in parallel, which is advantageous for processing on multicore computer systems. We have tested our method with datasets with upto 880 thousand objects on a machine with 16 cores, resulting in a decrease of runtime with a factor 27 compared to a single sequential process run. This more than linear speed-up indicates also an interesting algorithmic side-effect of our approach.
  • 关键词:Large datasets; parallel processing; generalization; vario-scale data structures
国家哲学社会科学文献中心版权所有