Data-aware scheduling of scientific workflows in hybrid clouds

Amirmohammad Pasdar; Khaled Almi’ani; Young Choon Lee

doi:10.1007/978-3-319-93713-7_68

Data-aware scheduling of scientific workflows in hybrid clouds

Amirmohammad Pasdar^*, Khaled Almi’ani, Young Choon Lee

^*Corresponding author for this work

School of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

8 Citations (Scopus)

Abstract

In this paper, we address the scheduling of scientific workflows in hybrid clouds considering data placement and present the Hybrid Scheduling for Hybrid Clouds (HSHC) algorithm. HSHC is a two-phase scheduling algorithm with a genetic algorithm based static phase and dynamic programming based dynamic phase. We evaluate HSHC with both a real-world scientific workflow application and random workflows in terms of makespan and costs.

Original language	English
Title of host publication	Computational Science – ICCS 2018
Subtitle of host publication	18th International Conference, Proceedings, Part III
Editors	Yong Shi, Haohuan Fu, Yingjie Tian, Valeria V. Krzhizhanovskaya, Michael Harold Lees, Jack Dongarra, Peter M. Sloot
Place of Publication	Cham
Publisher	Springer-VDI-Verlag GmbH & Co. KG
Pages	708-714
Number of pages	7
ISBN (Electronic)	9783319937137
ISBN (Print)	9783319937120
DOIs	https://doi.org/10.1007/978-3-319-93713-7_68
Publication status	Published - 2018
Event	18th International Conference on Computational Science, ICCS 2018 - Wuxi, China Duration: 11 Jun 2018 → 13 Jun 2018

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10862 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th International Conference on Computational Science, ICCS 2018
Country/Territory	China
City	Wuxi
Period	11/06/18 → 13/06/18

Access to Document

10.1007/978-3-319-93713-7_68

Cite this

Pasdar, A., Almi’ani, K., & Lee, Y. C. (2018). Data-aware scheduling of scientific workflows in hybrid clouds. In Y. Shi, H. Fu, Y. Tian, V. V. Krzhizhanovskaya, M. H. Lees, J. Dongarra, & P. M. Sloot (Eds.), Computational Science – ICCS 2018: 18th International Conference, Proceedings, Part III (pp. 708-714). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10862 LNCS). Springer-VDI-Verlag GmbH & Co. KG. https://doi.org/10.1007/978-3-319-93713-7_68

Pasdar, Amirmohammad ; Almi’ani, Khaled ; Lee, Young Choon. / Data-aware scheduling of scientific workflows in hybrid clouds. Computational Science – ICCS 2018: 18th International Conference, Proceedings, Part III. editor / Yong Shi ; Haohuan Fu ; Yingjie Tian ; Valeria V. Krzhizhanovskaya ; Michael Harold Lees ; Jack Dongarra ; Peter M. Sloot. Cham : Springer-VDI-Verlag GmbH & Co. KG, 2018. pp. 708-714 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{48552c5f0cad4f729643bd5ee79a0e26,

title = "Data-aware scheduling of scientific workflows in hybrid clouds",

abstract = "In this paper, we address the scheduling of scientific workflows in hybrid clouds considering data placement and present the Hybrid Scheduling for Hybrid Clouds (HSHC) algorithm. HSHC is a two-phase scheduling algorithm with a genetic algorithm based static phase and dynamic programming based dynamic phase. We evaluate HSHC with both a real-world scientific workflow application and random workflows in terms of makespan and costs.",

author = "Amirmohammad Pasdar and Khaled Almi{\textquoteright}ani and Lee, {Young Choon}",

year = "2018",

doi = "10.1007/978-3-319-93713-7_68",

language = "English",

isbn = "9783319937120",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-VDI-Verlag GmbH & Co. KG",

pages = "708--714",

editor = "Yong Shi and Haohuan Fu and Yingjie Tian and Krzhizhanovskaya, {Valeria V.} and Lees, {Michael Harold} and Jack Dongarra and Sloot, {Peter M.}",

booktitle = "Computational Science – ICCS 2018",

address = "Germany",

note = "18th International Conference on Computational Science, ICCS 2018 ; Conference date: 11-06-2018 Through 13-06-2018",

}

Pasdar, A, Almi’ani, K & Lee, YC 2018, Data-aware scheduling of scientific workflows in hybrid clouds. in Y Shi, H Fu, Y Tian, VV Krzhizhanovskaya, MH Lees, J Dongarra & PM Sloot (eds), Computational Science – ICCS 2018: 18th International Conference, Proceedings, Part III. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10862 LNCS, Springer-VDI-Verlag GmbH & Co. KG, Cham, pp. 708-714, 18th International Conference on Computational Science, ICCS 2018, Wuxi, China, 11/06/18. https://doi.org/10.1007/978-3-319-93713-7_68

Data-aware scheduling of scientific workflows in hybrid clouds. / Pasdar, Amirmohammad; Almi’ani, Khaled; Lee, Young Choon.
Computational Science – ICCS 2018: 18th International Conference, Proceedings, Part III. ed. / Yong Shi; Haohuan Fu; Yingjie Tian; Valeria V. Krzhizhanovskaya; Michael Harold Lees; Jack Dongarra; Peter M. Sloot. Cham: Springer-VDI-Verlag GmbH & Co. KG, 2018. p. 708-714 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10862 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

TY - GEN

T1 - Data-aware scheduling of scientific workflows in hybrid clouds

AU - Pasdar, Amirmohammad

AU - Almi’ani, Khaled

AU - Lee, Young Choon

PY - 2018

Y1 - 2018

N2 - In this paper, we address the scheduling of scientific workflows in hybrid clouds considering data placement and present the Hybrid Scheduling for Hybrid Clouds (HSHC) algorithm. HSHC is a two-phase scheduling algorithm with a genetic algorithm based static phase and dynamic programming based dynamic phase. We evaluate HSHC with both a real-world scientific workflow application and random workflows in terms of makespan and costs.

AB - In this paper, we address the scheduling of scientific workflows in hybrid clouds considering data placement and present the Hybrid Scheduling for Hybrid Clouds (HSHC) algorithm. HSHC is a two-phase scheduling algorithm with a genetic algorithm based static phase and dynamic programming based dynamic phase. We evaluate HSHC with both a real-world scientific workflow application and random workflows in terms of makespan and costs.

UR - http://www.scopus.com/inward/record.url?scp=85049052646&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-93713-7_68

DO - 10.1007/978-3-319-93713-7_68

M3 - Conference proceeding contribution

AN - SCOPUS:85049052646

SN - 9783319937120

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 708

EP - 714

BT - Computational Science – ICCS 2018

A2 - Shi, Yong

A2 - Fu, Haohuan

A2 - Tian, Yingjie

A2 - Krzhizhanovskaya, Valeria V.

A2 - Lees, Michael Harold

A2 - Dongarra, Jack

A2 - Sloot, Peter M.

PB - Springer-VDI-Verlag GmbH & Co. KG

CY - Cham

T2 - 18th International Conference on Computational Science, ICCS 2018

Y2 - 11 June 2018 through 13 June 2018

ER -

Pasdar A, Almi’ani K, Lee YC. Data-aware scheduling of scientific workflows in hybrid clouds. In Shi Y, Fu H, Tian Y, Krzhizhanovskaya VV, Lees MH, Dongarra J, Sloot PM, editors, Computational Science – ICCS 2018: 18th International Conference, Proceedings, Part III. Cham: Springer-VDI-Verlag GmbH & Co. KG. 2018. p. 708-714. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-93713-7_68

Data-aware scheduling of scientific workflows in hybrid clouds

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this