TY - GEN
T1 - A decoupled execution paradigm for data-intensive high-end computing
AU - Chen, Yong
AU - Chen, Chao
AU - Sun, Xian He
AU - Gropp, William D.
AU - Thakur, Rajeev
PY - 2012
Y1 - 2012
N2 - High-end computing (HEC) applications in critical areas of science and technology tend to be more and more data intensive. I/O has become a vital performance bottleneck of modern HEC practice. Conventional HEC execution paradigms, however, are computing-centric for computation intensive applications. They are designed to utilize memory and CPU performance and have inherent limitations in addressing the critical I/O bottleneck issues of HEC. In this study, we propose a decoupled execution paradigm (DEP) to address the challenging I/O bottleneck issues. DEP is the first paradigm enabling users to identify and handle data-intensive operations separately. It can significantly reduce costly data movement and is better than the existing execution paradigms for data-intensive applications. The initial experimental tests have confirmed its promising potential. Its data-centric architecture could have an impact in future HEC systems, programming models, and algorithms design and development.
AB - High-end computing (HEC) applications in critical areas of science and technology tend to be more and more data intensive. I/O has become a vital performance bottleneck of modern HEC practice. Conventional HEC execution paradigms, however, are computing-centric for computation intensive applications. They are designed to utilize memory and CPU performance and have inherent limitations in addressing the critical I/O bottleneck issues of HEC. In this study, we propose a decoupled execution paradigm (DEP) to address the challenging I/O bottleneck issues. DEP is the first paradigm enabling users to identify and handle data-intensive operations separately. It can significantly reduce costly data movement and is better than the existing execution paradigms for data-intensive applications. The initial experimental tests have confirmed its promising potential. Its data-centric architecture could have an impact in future HEC systems, programming models, and algorithms design and development.
KW - data-intensive computing
KW - decoupled execution paradigm
KW - high-end computing
KW - storage
UR - http://www.scopus.com/inward/record.url?scp=84870715661&partnerID=8YFLogxK
U2 - 10.1109/CLUSTER.2012.80
DO - 10.1109/CLUSTER.2012.80
M3 - Conference contribution
AN - SCOPUS:84870715661
SN - 9780768548074
T3 - Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
SP - 200
EP - 208
BT - Proceedings - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
PB - IEEE Computer Society
T2 - 2012 IEEE International Conference on Cluster Computing, CLUSTER 2012
Y2 - 24 September 2012 through 28 September 2012
ER -