首页    期刊浏览 2024年07月05日 星期五
登录注册

文章基本信息

  • 标题:An Evaluation Model and Benchmark for Parallel Computing Frameworks
  • 本地全文:下载
  • 作者:Weibei Fan ; Zhijie Han ; Ruchuan Wang
  • 期刊名称:Mobile Information Systems
  • 印刷版ISSN:1574-017X
  • 出版年度:2018
  • 卷号:2018
  • DOI:10.1155/2018/3890341
  • 出版社:Hindawi Publishing Corporation
  • 摘要:MARS and Spark are two popular parallel computing frameworks and widely used for large-scale data analysis. In this paper, we first propose a performance evaluation model based on support vector machine (SVM), which is used to analyze the performance of parallel computing frameworks. Furthermore, we give representative results of a set of analysis with the proposed analytical performance model and then perform a comparative evaluation of MARS and Spark by using representative workloads and considering factors, such as performance and scalability. The experiments show that our evaluation model has higher accuracy than multifactor line regression (MLR) in predicting execution time, and it also provides a resource consumption requirement. Finally, we study benchmark experiments between MARS and Spark. MARS has better performance than Spark in both throughput and speedup in the executions of logistic regression and Bayesian classification because MARS has a large number of GPU threads that can handle higher parallelism. It also shows that Spark has lower latency than MARS in the execution of the four benchmarks.
国家哲学社会科学文献中心版权所有