Change search
ReferencesLink to record
Permanent link

Direct link
A balanced scheduler with data reuse and replication for scientific workflows in cloud computing systems
Australia.
Karlstad University, Faculty of Health, Science and Technology (starting 2013), Department of Mathematics and Computer Science.
Australia, UK.
China.
Show others and affiliations
2016 (English)In: Future generations computer systems, ISSN 0167-739X, E-ISSN 1872-7115Article in journal (Refereed) In pressText
Abstract [en]

Cloud computing provides substantial opportunities to researchers who demand pay-as-you-go computing systems. Although cloud provider (e.g., Amazon Web Services) and application provider (e.g., biologists, physicists, and online gaming companies) both have specific performance requirements (e.g. application response time), it is the cloud scheduler’s responsibility to map the application to underlying cloud resources. This article presents a Balanced and file Reuse-Replication Scheduling (BaRRS) algorithm for cloud computing environments to optimally schedule scientific application workflows. BaRRS splits scientific workflows into multiple sub-workflows to balance system utilization via parallelization. It also exploits data reuse and replication techniques to optimize the amount of data that needs to be transferred among tasks at run-time. BaRRS analyzes the key application features (e.g., task execution times, dependency patterns and file sizes) of scientific workflows for adapting existing data reuse and replication techniques to cloud systems. Further, BaRRS performs a trade-off analysis to select the optimal solution based on two optimization constraints: execution time and monetary cost of running scientific workflows. BaRRS is compared with a state-of-the-art scheduling approach; experiments prove its superior performance. Experiments include four well known scientific workflows with different dependency patterns and data file sizes. Results were promising and also highlighted most critical factors affecting execution of scientific applications on clouds. 

Place, publisher, year, edition, pages
2016.
Keyword [en]
Big data; Cloud computing; Economic and social effects; Facsimile; Scheduling; Web services, Cloud computing environments; Data-intensive computing; Performance requirements; Replication techniques; Scientific applications; Scientific applications on clouds; Scientific workflows; Virtual machines, Distributed computer systems
National Category
Computer Science
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:kau:diva-42391DOI: 10.1016/j.future.2015.12.005ScopusID: 2-s2.0-84955245788OAI: oai:DiVA.org:kau-42391DiVA: diva2:933636
Available from: 2016-06-07 Created: 2016-05-23 Last updated: 2016-06-07Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Taheri, Javid
By organisation
Department of Mathematics and Computer Science
In the same journal
Future generations computer systems
Computer Science

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 49 hits
ReferencesLink to record
Permanent link

Direct link