On the trade-off between performance and storage efficiency of replication-based object storage

Hanbeom Jo; Youngjin Kim; Hochul Lee; Young Choon Lee; Hyuck Han; Sooyong Kang

doi:10.1109/CloudCom.2019.00051

On the trade-off between performance and storage efficiency of replication-based object storage

Hanbeom Jo, Youngjin Kim, Hochul Lee, Young Choon Lee, Hyuck Han, Sooyong Kang^*

^*Corresponding author for this work

School of Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

2 Citations (Scopus)

Abstract

The object storage systems are used to store and manage unstructured data. Most object storage systems provide the replication policy (REP) or erasure code policy (EC) to ensure the reliability and availability of data. In this paper, we study the trade-off between performance and storage efficiency of these policies with respect to different data sizes of user requests. To this end, we present a hybrid policy management system that takes advantage of both policies by automatically changing policy based on data size. We have implemented the hybrid system in OpenStack Swift. Our evaluation results show the throughput of GET request increases up to 36% while improving storage efficiency by up to 53% compared to that using the REP policy.

Original language	English
Title of host publication	Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019
Editors	Jinjun Chen, Laurence T. Yang
Place of Publication	Los Alamitos, CA
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	301-304
Number of pages	4
ISBN (Electronic)	9781728150116
DOIs	https://doi.org/10.1109/CloudCom.2019.00051
Publication status	Published - 2019
Event	11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019 - Sydney, Australia Duration: 11 Dec 2019 → 13 Dec 2019

Publication series

Name	International Conference on Cloud Computing Technology and Science
Publisher	IEEE COMPUTER SOC
ISSN (Print)	2330-2194

Conference

Conference	11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019
Country/Territory	Australia
City	Sydney
Period	11/12/19 → 13/12/19

Keywords

Erasure coding
Hybrid storage policy
Object storage
OpenStack swift
Replication

Access to Document

10.1109/CloudCom.2019.00051

Cite this

Jo, H., Kim, Y., Lee, H., Lee, Y. C., Han, H., & Kang, S. (2019). On the trade-off between performance and storage efficiency of replication-based object storage. In J. Chen, & L. T. Yang (Eds.), Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019 (pp. 301-304). (International Conference on Cloud Computing Technology and Science). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/CloudCom.2019.00051

Jo, Hanbeom ; Kim, Youngjin ; Lee, Hochul et al. / On the trade-off between performance and storage efficiency of replication-based object storage. Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019. editor / Jinjun Chen ; Laurence T. Yang. Los Alamitos, CA : Institute of Electrical and Electronics Engineers (IEEE), 2019. pp. 301-304 (International Conference on Cloud Computing Technology and Science).

@inproceedings{7977dcd4d2134abfb324d7183e00d287,

title = "On the trade-off between performance and storage efficiency of replication-based object storage",

abstract = "The object storage systems are used to store and manage unstructured data. Most object storage systems provide the replication policy (REP) or erasure code policy (EC) to ensure the reliability and availability of data. In this paper, we study the trade-off between performance and storage efficiency of these policies with respect to different data sizes of user requests. To this end, we present a hybrid policy management system that takes advantage of both policies by automatically changing policy based on data size. We have implemented the hybrid system in OpenStack Swift. Our evaluation results show the throughput of GET request increases up to 36% while improving storage efficiency by up to 53% compared to that using the REP policy.",

keywords = "Erasure coding, Hybrid storage policy, Object storage, OpenStack swift, Replication",

author = "Hanbeom Jo and Youngjin Kim and Hochul Lee and Lee, {Young Choon} and Hyuck Han and Sooyong Kang",

year = "2019",

doi = "10.1109/CloudCom.2019.00051",

language = "English",

series = "International Conference on Cloud Computing Technology and Science",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

pages = "301--304",

editor = "Jinjun Chen and Yang, {Laurence T.}",

booktitle = "Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019",

address = "United States",

note = "11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019 ; Conference date: 11-12-2019 Through 13-12-2019",

}

Jo, H, Kim, Y, Lee, H, Lee, YC, Han, H & Kang, S 2019, On the trade-off between performance and storage efficiency of replication-based object storage. in J Chen & LT Yang (eds), Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019. International Conference on Cloud Computing Technology and Science, Institute of Electrical and Electronics Engineers (IEEE), Los Alamitos, CA, pp. 301-304, 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019, Sydney, Australia, 11/12/19. https://doi.org/10.1109/CloudCom.2019.00051

On the trade-off between performance and storage efficiency of replication-based object storage. / Jo, Hanbeom; Kim, Youngjin; Lee, Hochul et al.
Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019. ed. / Jinjun Chen; Laurence T. Yang. Los Alamitos, CA: Institute of Electrical and Electronics Engineers (IEEE), 2019. p. 301-304 (International Conference on Cloud Computing Technology and Science).

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution › peer-review

TY - GEN

T1 - On the trade-off between performance and storage efficiency of replication-based object storage

AU - Jo, Hanbeom

AU - Kim, Youngjin

AU - Lee, Hochul

AU - Lee, Young Choon

AU - Han, Hyuck

AU - Kang, Sooyong

PY - 2019

Y1 - 2019

N2 - The object storage systems are used to store and manage unstructured data. Most object storage systems provide the replication policy (REP) or erasure code policy (EC) to ensure the reliability and availability of data. In this paper, we study the trade-off between performance and storage efficiency of these policies with respect to different data sizes of user requests. To this end, we present a hybrid policy management system that takes advantage of both policies by automatically changing policy based on data size. We have implemented the hybrid system in OpenStack Swift. Our evaluation results show the throughput of GET request increases up to 36% while improving storage efficiency by up to 53% compared to that using the REP policy.

AB - The object storage systems are used to store and manage unstructured data. Most object storage systems provide the replication policy (REP) or erasure code policy (EC) to ensure the reliability and availability of data. In this paper, we study the trade-off between performance and storage efficiency of these policies with respect to different data sizes of user requests. To this end, we present a hybrid policy management system that takes advantage of both policies by automatically changing policy based on data size. We have implemented the hybrid system in OpenStack Swift. Our evaluation results show the throughput of GET request increases up to 36% while improving storage efficiency by up to 53% compared to that using the REP policy.

KW - Erasure coding

KW - Hybrid storage policy

KW - Object storage

KW - OpenStack swift

KW - Replication

UR - http://www.scopus.com/inward/record.url?scp=85079037399&partnerID=8YFLogxK

U2 - 10.1109/CloudCom.2019.00051

DO - 10.1109/CloudCom.2019.00051

M3 - Conference proceeding contribution

AN - SCOPUS:85079037399

T3 - International Conference on Cloud Computing Technology and Science

SP - 301

EP - 304

BT - Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019

A2 - Chen, Jinjun

A2 - Yang, Laurence T.

PB - Institute of Electrical and Electronics Engineers (IEEE)

CY - Los Alamitos, CA

T2 - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019

Y2 - 11 December 2019 through 13 December 2019

ER -

Jo H, Kim Y, Lee H, Lee YC, Han H, Kang S. On the trade-off between performance and storage efficiency of replication-based object storage. In Chen J, Yang LT, editors, Proceedings - 11th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2019, 19th IEEE International Conference on Computer and Information Technology, CIT 2019, 2019 International Workshop on Resource Brokering with Blockchain, RBchain 2019 and 2019 Asia-Pacific Services Computing Conference, APSCC 2019. Los Alamitos, CA: Institute of Electrical and Electronics Engineers (IEEE). 2019. p. 301-304. (International Conference on Cloud Computing Technology and Science). doi: 10.1109/CloudCom.2019.00051

On the trade-off between performance and storage efficiency of replication-based object storage

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this