FluidMeM: full, flexible, and fast memory disaggregation for the cloud

Blake Caldwell, Sepideh Goodarzy, Sangtae Ha, Richard Han, Eric Keller, Eric Rozner, Youngbin Im

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

This paper presents a new approach to memory disaggregation called FluidMem that leverages the userfault mechanism in Linux to achieve full memory disaggregation in software. FluidMem enables dynamic and transparent resizing of an unmodified Virtual Machine’s (VM’s) memory footprint in the cloud. As a result, a VM’s memory footprint can seamlessly scale over multiple machines or even be downsized to a near-zero footprint on a given server. FluidMem’s architecture provides flexibility to cloud operators to manage remote memory without requiring guest intervention, while also supporting paging out the entirety of a VM’s pages within its address space. FluidMem integrates with a remote memory backend in a modular way, easily supporting systems such as RAMCloud to harness remote memory. We demonstrate FluidMem outperforms an existing memory disaggregation approach based on network swap. Microbenchmarks are evaluated to characterize the latency of different components of the FluidMem architecture, and two memory-intensive applications are demonstrated using FluidMem, the Graph500 benchmark, and MongoDB. Additionally, we show FluidMem can flexibly and efficiently grow and shrink the memory footprint of a VM as defined by a cloud provider.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE 40th International Conference on Distributed Computing Systems, ICDCS 2020
Place of PublicationLos Alamitos, California
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages665-677
Number of pages13
ISBN (Electronic)9781728170022
DOIs
Publication statusPublished - 2020
Externally publishedYes
Event40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020 - Singapore, Singapore
Duration: 29 Nov 20201 Dec 2020

Publication series

NameProceedings - International Conference on Distributed Computing Systems
Volume2020-November

Conference

Conference40th IEEE International Conference on Distributed Computing Systems, ICDCS 2020
CountrySingapore
CitySingapore
Period29/11/201/12/20

Keywords

  • memory disaggregation
  • Cloud
  • Virtualization

Fingerprint Dive into the research topics of 'FluidMeM: full, flexible, and fast memory disaggregation for the cloud'. Together they form a unique fingerprint.

Cite this