首页    期刊浏览 2024年11月27日 星期三
登录注册

文章基本信息

  • 标题:Evolutionary Scheduling of Dynamic Multitasking Workloads for Big-Data Analytics in Elastic Cloud
  • 作者:Fan Zhang ; Junwei Cao ; Wei Tan
  • 期刊名称:IEEE Transactions on Emerging Topics in Computing
  • 印刷版ISSN:2168-6750
  • 出版年度:2014
  • 卷号:2
  • 期号:3
  • 页码:338-351
  • DOI:10.1109/TETC.2014.2348196
  • 语种:English
  • 出版社:IEEE Publishing
  • 摘要:

    Scheduling of dynamic and multitasking workloads for big-data analytics is a challenging issue, as it requires a significant amount of parameter sweeping and iterations. Therefore, real-time scheduling becomes essential to increase the throughput of many-task computing. The difficulty lies in obtaining a series of optimal yet responsive schedules. In dynamic scenarios, such as virtual clusters in cloud, scheduling must be processed fast enough to keep pace with the unpredictable fluctuations in the workloads to optimize the overall system performance. In this paper, ordinal optimization using rough models and fast simulation is introduced to obtain suboptimal solutions in a much shorter timeframe. While the scheduling solution for each period may not be the best, ordinal optimization can be processed fast in an iterative and evolutionary way to capture the details of big-data workload dynamism. Experimental results show that our evolutionary approach compared with existing methods, such as Monte Carlo and Blind Pick, can achieve higher overall average scheduling performance, such as throughput, in real-world applications with dynamic workloads. Furthermore, performance improvement is seen by implementing an optimal computing budget allocating method that smartly allocates computing cycles to the most promising schedules.

  • 关键词:Big Data; Monte Carlo methods; cloud computing; evolutionary computation; iterative methods; optimisation; scheduling; Monte Carlo; average scheduling performance; big-data analytics; big-data workload dynamism; blind pick; computing cycles; dynamic multitasking workloads; elastic cloud; evolutionary approach; evolutionary scheduling; iterations; many-task computing; optimal computing budget allocating method; ordinal optimization; parameter sweeping; rough models; virtual clusters; Dynamic scheduling; Monte Carlo methods; Optimization; Processor scheduling; Schedules; Throughput; Big-data; cloud computing; evolutionary ordinal optimization; multitasking workload; virtual clusters
Loading...
联系我们|关于我们|网站声明
国家哲学社会科学文献中心版权所有