Performance evaluation of the SSD-based swap system for big data processing

Jaehun Lee, Sungmin Park, Minsoo Ryu, Sooyong Kang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

3 Citations (Scopus)

Abstract

Solid State Drives (SSDs) are quickly replacing HDDs not only in laptops but also in servers. Since SSD uses semiconductor, i.e., NAND flash memory, as its storage medium, it locates itself between memory and storage: it is faster but more expensive than HDD, and slower but cheaper than DRAM. Meanwhile, big data processing systems require both faster storage and larger memory. While lots of works have been conducted on evaluating the performance enhancement in big data processing systems by replacing HDD with SSD, the effect of SSD as a simple memory extension, i.e., Swap device, has not been studied, sufficiently. In this paper, we investigate the feasibility of using SSD as a swap device for big data processing systems through extensive experiments. Experimental results show that 1) incredibly large amount of IO's are issued to swap device when the physical memory cannot accommodate all data for processing, 2) SSD processes IO's to a swap device significantly faster than HDD, 3) using SSD as a storage device is a far better choice than using it as a swap device, and 4) enterprise SSD is not cost effective when it is used as a swap device.

Original languageEnglish
Title of host publicationProceedings - 2014 IEEE 13th International Conference on Trust, Security and Privacy in Computing and Communications
Subtitle of host publicationTrustCom 2014
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages673-680
Number of pages8
ISBN (Electronic)9781479965137
ISBN (Print)9781479965144
DOIs
Publication statusPublished - 2014
Externally publishedYes
Event13th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2014 - Beijing, China
Duration: 24 Sep 201426 Sep 2014

Publication series

NameIEEE International Conference on Trust Security and Privacy in Computing and Communications
PublisherIEEE
ISSN (Print)2324-898X

Other

Other13th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, TrustCom 2014
CountryChina
CityBeijing
Period24/09/1426/09/14

Keywords

  • Big Data Processing
  • Swap
  • Solid State Drive
  • MapReduce
  • Storage
  • Solid state drive
  • Big data processing

Fingerprint

Dive into the research topics of 'Performance evaluation of the SSD-based swap system for big data processing'. Together they form a unique fingerprint.

Cite this