DOSAS: Mitigating the resource contention in active storage systems

Chao Chen, Yong Chen, Philip C. Roth

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Active storage provides an effective method to mitigate the I/O bottleneck problem of data intensive high performance computing applications. It can reduce the amount of data transferred as the application runs by moving appropriate computations close to the data. Prior research has achieved considerable progress in developing several active storage prototypes. However, existing studies have neglected the impact of resource contention when concurrent processes request IOoperations from the same storage node simultaneously, which happens frequently in practice. In this paper, we analyze the impact of resource contention on active storage systems. Motivated by our analysis, we propose a novel Dynamic Operation Scheduling Active Storage architecture to address the resource contention issue. It offloads the active processing operations dynamically between storage nodes and compute nodes according to the system environment. By evaluating our architecture, we observed that: (1) resource contention is a critical problem for active storage systems, (2) the proposed dynamic operation scheduling method mitigates the problem, and (3) the new active storage architecture outperforms existing active storage systems.

Original languageEnglish
Title of host publicationProceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
PublisherIEEE Computer Society
Pages164-172
Number of pages9
ISBN (Print)9780768548074
DOIs
StatePublished - 2012
Event2012 IEEE International Conference on Cluster Computing, CLUSTER 2012 - Beijing, China
Duration: Sep 24 2012Sep 28 2012

Publication series

NameProceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012

Conference

Conference2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
CountryChina
CityBeijing
Period09/24/1209/28/12

Keywords

  • active storage
  • data intensive computing
  • dynamic active storage
  • high performance computing
  • parallel I/O
  • parallel file systems
  • resource contention

Fingerprint Dive into the research topics of 'DOSAS: Mitigating the resource contention in active storage systems'. Together they form a unique fingerprint.

  • Cite this

    Chen, C., Chen, Y., & Roth, P. C. (2012). DOSAS: Mitigating the resource contention in active storage systems. In Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012 (pp. 164-172). [6337777] (Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012). IEEE Computer Society. https://doi.org/10.1109/CLUSTER.2012.66