Hierarchical recursive resource sharing for containerized applications

Young Jin Kim, Young Choon Lee, Hyuck Han, Sooyong Kang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

2 Citations (Scopus)

Abstract

Applications are increasingly containerized using techniques, such as LXC and Docker. Scientific workflow applications are no exception. In this paper, we address the problem of resource contention between concurrently running containerized scientific workflows. To this end, we design and implement Hierarchical Recursive Resource Sharing (HRRS), which structures multiple concurrent containers in a hierarchy that automatically and dynamically regulates their resource consumption based on their level/tier in the hierarchy. The hierarchy is recursively updated as the top-tier container completes its execution with the second-tier container becoming the top-tier container inheriting the resource consumption priority. We have evaluated the performance of HRRS using multiple large-scale scientific workflows containerized by Docker. The experimental results show the significant reduction of resource contention as evident in performance improvement of 49%, 160% and 18% compared with sequential execution, concurrent execution with fair resource share and execution with submission interval, respectively.

Original languageEnglish
Title of host publicationService-Oriented Computing
Subtitle of host publication16th International Conference, ICSOC 2018, Proceedings
EditorsClaus Pahl, Maja Vukovic, Jianwei Yin, Qi Yu
Place of PublicationSwitzerland
PublisherSpringer-VDI-Verlag GmbH & Co. KG
Pages781-796
Number of pages16
ISBN (Electronic)9783030035969
ISBN (Print)9783030035952
DOIs
Publication statusPublished - 1 Jan 2018
Event16th International Conference on Service-Oriented Computing, ICSOC 2018 - Hangzhou, China
Duration: 12 Nov 201815 Nov 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11236 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Service-Oriented Computing, ICSOC 2018
CountryChina
CityHangzhou
Period12/11/1815/11/18

Keywords

  • Containerized scientific workflows
  • Containers
  • Resource sharing

Fingerprint Dive into the research topics of 'Hierarchical recursive resource sharing for containerized applications'. Together they form a unique fingerprint.

Cite this