Unified and efficient HEC storage system with a working-set based reorganization scheme

Junjie Chen, Yong Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

High-end computing (HEC) applications and simulations have become increasingly data intensive. The pressure on the storage system capability has substantially increased in recent years. Traditional hard disk drives (HDD) are dominant storage devices in HEC, but suffer seek time delays and rotational latencies. The emerged storage class memory such as Solid State Drive (SSD) provides a new promising high bandwidth and low latency storage solution, but with inherent limitations of small capacity, limited writing cycles, and high cost. SSDs and HDDs have complement characteristics in nature and there is a desire to combine and unify them to best serve HEC workloads. In this paper, we introduce our initial study of a novelWorking-Set based Reorganization Scheme (WS-ROS), to manage and leverage the merits of both SSDs and HDDs and to provide a highly efficient storage system. The goal of the proposed scheme is to leverage SSDs service more read requests through keeping active data and to leverage HDDs to keep large non-active data and extend SSDs writing cycles. The preliminary evaluations have shown that the proposed scheme has significant advantages and holds a promise as a unified storage management scheme for HEC workloads.

Original languageEnglish
Title of host publication2013 IEEE International Conference on Cluster Computing, CLUSTER 2013
DOIs
StatePublished - 2013
Event15th IEEE International Conference on Cluster Computing, CLUSTER 2013 - Indianapolis, IN, United States
Duration: Sep 23 2013Sep 27 2013

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Conference

Conference15th IEEE International Conference on Cluster Computing, CLUSTER 2013
CountryUnited States
CityIndianapolis, IN
Period09/23/1309/27/13

Keywords

  • High-end computing
  • Solid State Drives
  • data intensive computing
  • parallel file systems
  • storage

Fingerprint Dive into the research topics of 'Unified and efficient HEC storage system with a working-set based reorganization scheme'. Together they form a unique fingerprint.

  • Cite this

    Chen, J., & Chen, Y. (2013). Unified and efficient HEC storage system with a working-set based reorganization scheme. In 2013 IEEE International Conference on Cluster Computing, CLUSTER 2013 [6702620] (Proceedings - IEEE International Conference on Cluster Computing, ICCC). https://doi.org/10.1109/CLUSTER.2013.6702620