A resource allocation controller for key-value data stores

Young Ki Kim, F. M. Reza Hoseiny, Young Choon Lee, Albert Y. Zomaya

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contribution

1 Citation (Scopus)

Abstract

Recent distributed key-value data stores, such as Aerospike are getting the momentum with ever-increasing need for large-scale real-time data processing. While these data stores can provide significantly improved performance, they still struggle to meet Quality of Service (QoS) during workload surges. In this paper, we address the problem of QoS-aware resource allocation for burst workloads in key-value data stores. To this end, we design a resource allocation controller, which enables each application to independently regulate the releases of its requests taking into account QoS. In particular, the proposed controller monitors the actual performance metrics of the target system and dynamically releases requests from a buffer owned by each application accordingly. We have implemented the proposed controller in an Aerospike cluster for our performance evaluation. Experiments have been conducted with various workload intensities (with up to 36,180 write operations per second) in comparison with the default Aerospike policy. Experimental results confirm that the proposed controller decreases the overall average latency up to 41% on high-rate workload while maintaining the QoS of high priority applications.

Original languageEnglish
Title of host publication2017 IEEE 16th International Symposium on Network Computing and Applications
Subtitle of host publicationNCA 2017
EditorsAris Gkoulalas-Divanis, Miguel P. Correia, Dimiter R. Avresky
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages1-4
Number of pages4
ISBN (Electronic)9781538614655
ISBN (Print)9781538614662, 9781538614648
DOIs
Publication statusPublished - 8 Dec 2017
Event16th IEEE International Symposium on Network Computing and Applications, NCA 2017 - Cambridge, United States
Duration: 30 Oct 20171 Nov 2017

Conference

Conference16th IEEE International Symposium on Network Computing and Applications, NCA 2017
CountryUnited States
CityCambridge
Period30/10/171/11/17

Keywords

  • Dynamic Resource Controller
  • Key-value Data Store
  • QoS-Aware Resource Allocation

Fingerprint Dive into the research topics of 'A resource allocation controller for key-value data stores'. Together they form a unique fingerprint.

Cite this