SSDUP: An efficient SSD write buffer using pipeline

Ming Li, Xuanhua Shi, Wei Liu, Hai Jin, Yong Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

High performance computing (HPC) applications are becoming more data-intensive and produce increasingly large I/O demands on storage systems. New storage devices such as SSD which has nearly no seek latency and high throughput have been widely used together with HDD to serve as a hybrid storage system. To solve the I/O bottleneck problem, existing hybrid storage solutions such as Burst Buffer have been proposed as intermediate layer between clients and disks to absorb burst I/O requests and improve write performance. However Burst Buffer needs sufficient SSD space to meet the maximum burst I/O requests which is still a costly solution. In this paper, we propose a hybrid architecture called SSDUP (an SSD write buffer Using Pipeline) for HPC storage systems, which uses NAND flash based SSD as a write-back buffer for HDD. With our efforts, SSDUP can achieve a good performance by using limited SSD space.

Original languageEnglish
Title of host publicationProceedings - 2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages166-167
Number of pages2
ISBN (Electronic)9781509036530
DOIs
StatePublished - Dec 6 2016
Event2016 IEEE International Conference on Cluster Computing, CLUSTER 2016 - Taipei, Taiwan, Province of China
Duration: Sep 13 2016Sep 15 2016

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Conference

Conference2016 IEEE International Conference on Cluster Computing, CLUSTER 2016
CountryTaiwan, Province of China
CityTaipei
Period09/13/1609/15/16

    Fingerprint

Keywords

  • High performance computing
  • Hybrid storage system
  • Solid state drive
  • Write performance

Cite this

Li, M., Shi, X., Liu, W., Jin, H., & Chen, Y. (2016). SSDUP: An efficient SSD write buffer using pipeline. In Proceedings - 2016 IEEE International Conference on Cluster Computing, CLUSTER 2016 (pp. 166-167). [7776504] (Proceedings - IEEE International Conference on Cluster Computing, ICCC). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CLUSTER.2016.88