A layout-aware optimization strategy for collective I/O

Yong Chen; Huaiming Song; Rajeev Thakur; Xian He Sun

doi:10.1145/1851476.1851530

A layout-aware optimization strategy for collective I/O

Yong Chen, Huaiming Song, Rajeev Thakur, Xian He Sun

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

In this study, we propose an optimization strategy to promote a better integration of the parallel I/O middleware and parallel file systems. We illustrate that a layout-aware optimization strategy can improve the performance of current collective I/O in parallel I/O system. We present the motivation, prototype design and initial verification of the proposed layout-aware optimization strategy. The analytical and initial experimental testing results demonstrate that the proposed strategy has a potential in improving the parallel I/O system performance.

Original language	English
Title of host publication	HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Pages	360-363
Number of pages	4
DOIs	https://doi.org/10.1145/1851476.1851530
State	Published - 2010
Event	19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010 - Chicago, IL, United States Duration: Jun 21 2010 → Jun 25 2010

Publication series

Name	HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Conference

Conference	19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010
Country/Territory	United States
City	Chicago, IL
Period	06/21/10 → 06/25/10

Keywords

Collective I/O
Data layout
MPI I/O
Parallel I/O
Parallel file system
Petascale file system

Access to Document

10.1145/1851476.1851530

Cite this

Chen, Y., Song, H., Thakur, R., & Sun, X. H. (2010). A layout-aware optimization strategy for collective I/O. In HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing (pp. 360-363). (HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing). https://doi.org/10.1145/1851476.1851530

@inproceedings{c3845ae6dba5478ba8e35f9ae8d56954,

title = "A layout-aware optimization strategy for collective I/O",

abstract = "In this study, we propose an optimization strategy to promote a better integration of the parallel I/O middleware and parallel file systems. We illustrate that a layout-aware optimization strategy can improve the performance of current collective I/O in parallel I/O system. We present the motivation, prototype design and initial verification of the proposed layout-aware optimization strategy. The analytical and initial experimental testing results demonstrate that the proposed strategy has a potential in improving the parallel I/O system performance.",

keywords = "Collective I/O, Data layout, MPI I/O, Parallel I/O, Parallel file system, Petascale file system",

author = "Yong Chen and Huaiming Song and Rajeev Thakur and Sun, {Xian He}",

year = "2010",

doi = "10.1145/1851476.1851530",

language = "English",

isbn = "9781605589428",

series = "HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing",

pages = "360--363",

booktitle = "HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing",

note = "19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010 ; Conference date: 21-06-2010 Through 25-06-2010",

}

Chen, Y, Song, H, Thakur, R & Sun, XH 2010, A layout-aware optimization strategy for collective I/O. in HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 360-363, 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010, Chicago, IL, United States, 06/21/10. https://doi.org/10.1145/1851476.1851530

A layout-aware optimization strategy for collective I/O. / Chen, Yong; Song, Huaiming; Thakur, Rajeev et al.
HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. 2010. p. 360-363 (HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A layout-aware optimization strategy for collective I/O

AU - Chen, Yong

AU - Song, Huaiming

AU - Thakur, Rajeev

AU - Sun, Xian He

PY - 2010

Y1 - 2010

N2 - In this study, we propose an optimization strategy to promote a better integration of the parallel I/O middleware and parallel file systems. We illustrate that a layout-aware optimization strategy can improve the performance of current collective I/O in parallel I/O system. We present the motivation, prototype design and initial verification of the proposed layout-aware optimization strategy. The analytical and initial experimental testing results demonstrate that the proposed strategy has a potential in improving the parallel I/O system performance.

AB - In this study, we propose an optimization strategy to promote a better integration of the parallel I/O middleware and parallel file systems. We illustrate that a layout-aware optimization strategy can improve the performance of current collective I/O in parallel I/O system. We present the motivation, prototype design and initial verification of the proposed layout-aware optimization strategy. The analytical and initial experimental testing results demonstrate that the proposed strategy has a potential in improving the parallel I/O system performance.

KW - Collective I/O

KW - Data layout

KW - MPI I/O

KW - Parallel I/O

KW - Parallel file system

KW - Petascale file system

UR - http://www.scopus.com/inward/record.url?scp=78649982923&partnerID=8YFLogxK

U2 - 10.1145/1851476.1851530

DO - 10.1145/1851476.1851530

M3 - Conference contribution

AN - SCOPUS:78649982923

SN - 9781605589428

T3 - HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

SP - 360

EP - 363

BT - HPDC 2010 - Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

T2 - 19th ACM International Symposium on High Performance Distributed Computing, HPDC 2010

Y2 - 21 June 2010 through 25 June 2010

ER -

A layout-aware optimization strategy for collective I/O

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this