Towards scalable I/O architecture for exascale systems

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations

Abstract

High performance computing (HPC) has crossed the Petaflop mark and is reaching the Exaflop range quickly. The exascale system is projected to have millions of nodes, with thousands of cores for each node. At such an extreme scale, the substantial amount of concurrency can cause a critical contention issue for I/O system. The contention can destroy the request locality, increase the access latency, and waste the precious I/O interconnection bandwidth. This study proposes a dynamically coordinated I/O architecture for exascale systems. The fundamental idea is to coordinate I/O accesses according to access pattern, network topology, interconnection condition, and data distribution on storage devices to reduce the contention and regain the locality. The preliminary results have shown the promise of a dynamically coordinated I/O architecture. It has a potential to manage the substantial amount of I/O concurrency and provides a scalable I/O architecture for exascale systems.

Original languageEnglish
Title of host publicationMTAGS'11 - Proceedings of the 2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, Co-located with SC'11
Pages43-48
Number of pages6
DOIs
StatePublished - 2011
Event2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, MTAGS'11, Co-located with SC'11 - Seattle, WA, United States
Duration: Nov 14 2011Nov 14 2011

Publication series

NameMTAGS'11 - Proceedings of the 2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, Co-located with SC'11

Conference

Conference2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, MTAGS'11, Co-located with SC'11
CountryUnited States
CitySeattle, WA
Period11/14/1111/14/11

Keywords

  • exascale systems
  • high performance computing
  • many-task computing
  • parallel I/O
  • parallel file systems
  • scalable I/O architecture
  • storage

Fingerprint Dive into the research topics of 'Towards scalable I/O architecture for exascale systems'. Together they form a unique fingerprint.

  • Cite this

    Chen, Y. (2011). Towards scalable I/O architecture for exascale systems. In MTAGS'11 - Proceedings of the 2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, Co-located with SC'11 (pp. 43-48). (MTAGS'11 - Proceedings of the 2011 ACM International Workshop on Many Task Computing on Grids and Supercomputers, Co-located with SC'11). https://doi.org/10.1145/2132876.2132887