LACIO: A New Layout-Aware Collective I/O Strategy for Parallel I/O Systems

Yong Chen, Xian-He Sun, Rajeev Thakur, Philip C Roth, William D Gropp

Research output: Contribution to conferencePaper

Abstract

Parallel applications benefit considerably from the rapid advance of processor architectures and the available massive computational capability, but their performance suffers from large latency of I/O accesses. The poor I/O performance has been attributed as a critical cause of the low sustained performance of parallel systems. Collective I/O is widely considered a critical solution that exploits the correlation among I/O accesses from multiple processes of a parallel application and optimizes the I/O performance. However, the conventional collective I/O strategy makes the optimization decision based on the logical file layout to avoid multiple file system calls and does not take the physical data layout into consideration. On the other hand, the physical data layout in fact decides the actual I/O access locality and concurrency. In this study, we propose a new collective I/O strategy that is aware of the underlying physical data layout. We confirm that the new Layout-Aware Collective I/O
Original languageEnglish
StatePublished - May 16 2011

Cite this

Chen, Y., Sun, X-H., Thakur, R., Roth, P. C., & Gropp, W. D. (2011). LACIO: A New Layout-Aware Collective I/O Strategy for Parallel I/O Systems.