On the trade-off between performance and storage efficiency of replication-based object storage

Hanbeom Jo, Youngjin Kim, Hochul Lee, Young Choon Lee, Hyuck Han, Sooyong Kang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

Abstract

The object storage systems are used to store and manage unstructured data. Most object storage systems provide the replication policy (REP) or erasure code policy (EC) to ensure the reliability and availability of data. In this paper, we study the trade-off between performance and storage efficiency of these policies with respect to different data sizes of user requests. To this end, we present a hybrid policy management system that takes advantage of both policies by automatically changing policy based on data size. We have implemented the hybrid system in OpenStack Swift. Our evaluation results show the throughput of GET request increases up to 36% while improving storage efficiency by up to 53% compared to that using the REP policy.

Original languageEnglish
Title of host publicationProceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019
EditorsJinjun Chen, Laurence T. Yang
Place of PublicationLos Alamitos, CA
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages301-304
Number of pages4
ISBN (Electronic)9781728150116
DOIs
Publication statusPublished - 2019
Event11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019 - Sydney, Australia
Duration: 11 Dec 201913 Dec 2019

Publication series

NameInternational Conference on Cloud Computing Technology and Science
PublisherIEEE COMPUTER SOC
ISSN (Print)2330-2194

Conference

Conference11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019
CountryAustralia
CitySydney
Period11/12/1913/12/19

Keywords

  • Erasure coding
  • Hybrid storage policy
  • Object storage
  • OpenStack swift
  • Replication

Fingerprint Dive into the research topics of 'On the trade-off between performance and storage efficiency of replication-based object storage'. Together they form a unique fingerprint.

Cite this