Data layout optimization for petascale file systems

Xian He Sun, Yong Chen, Yanlong Yin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

In this study, the authors propose a simple performance model to promote a better integration between the parallel I/O middleware layer and parallel file systems. They show that application-specific data layout optimization can improve overall data access delay considerably for many applications. Implementation results under MPI-IO middleware and PVFS2 file system confirm the correctness and effectiveness of their approach, and demonstrate the potential of data layout optimization in petascale data storage.

Original languageEnglish
Title of host publicationProceedings of the 4th Annual Petascale Data Storage Workshop, PDSW '09, Held in conjunction with Supercomputing '09
Pages11-15
Number of pages5
DOIs
StatePublished - 2009
Event4th Annual Petascale Data Storage Workshop, PDSW '09, Held in conjunction with Supercomputing '09 - Portland, OR, United States
Duration: Nov 15 2009Nov 15 2009

Publication series

NameProceedings of the 4th Annual Petascale Data Storage Workshop, PDSW '09, Held in conjunction with Supercomputing '09

Conference

Conference4th Annual Petascale Data Storage Workshop, PDSW '09, Held in conjunction with Supercomputing '09
CountryUnited States
CityPortland, OR
Period11/15/0911/15/09

Keywords

  • Data layout
  • Parallel I/O
  • Parallel file systems

Fingerprint Dive into the research topics of 'Data layout optimization for petascale file systems'. Together they form a unique fingerprint.

Cite this