TY - GEN
T1 - Log-Assisted Straggler-Aware I/O Scheduler for High-End Computing
AU - Tavakoli, Neda
AU - Dai, Dong
AU - Chen, Yong
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2016/9/23
Y1 - 2016/9/23
N2 - Object-based parallel file systems have emerged as promising storage solutions for high-end computing (HEC) systems. Despite the fact that object storage provides a flexible interface, scheduling highly concurrent I/O requests that access a large number of objects still remains as a challenging problem, especially in the case when stragglers (storage servers that are significantly slower than others) exist in the system. An efficient I/O scheduler needs to avoid possible stragglers to achieve low latency and high throughput. In this paper, we introduce a log-assisted straggler-aware I/O scheduling to mitigate the impact of storage server stragglers. The contribution of this study is threefold. First, we introduce a client-side, log-assisted, straggler-aware I/O scheduler architecture to tackle the storage straggler issue in HEC systems. Second, we present two scheduling algorithms that can make efficient decision on scheduling I/Os while avoiding stragglers based on such an architecture. Third, we evaluate the proposed I/O scheduler using simulations. The simulation results have confirmed the promise of the newly introduced log-assisted straggler-aware I/O scheduler in large-scale HEC systems.
AB - Object-based parallel file systems have emerged as promising storage solutions for high-end computing (HEC) systems. Despite the fact that object storage provides a flexible interface, scheduling highly concurrent I/O requests that access a large number of objects still remains as a challenging problem, especially in the case when stragglers (storage servers that are significantly slower than others) exist in the system. An efficient I/O scheduler needs to avoid possible stragglers to achieve low latency and high throughput. In this paper, we introduce a log-assisted straggler-aware I/O scheduling to mitigate the impact of storage server stragglers. The contribution of this study is threefold. First, we introduce a client-side, log-assisted, straggler-aware I/O scheduler architecture to tackle the storage straggler issue in HEC systems. Second, we present two scheduling algorithms that can make efficient decision on scheduling I/Os while avoiding stragglers based on such an architecture. Third, we evaluate the proposed I/O scheduler using simulations. The simulation results have confirmed the promise of the newly introduced log-assisted straggler-aware I/O scheduler in large-scale HEC systems.
KW - High-end computing
KW - I/O scheduler
KW - Parallel file systems
UR - http://www.scopus.com/inward/record.url?scp=84990931019&partnerID=8YFLogxK
U2 - 10.1109/ICPPW.2016.38
DO - 10.1109/ICPPW.2016.38
M3 - Conference contribution
AN - SCOPUS:84990931019
T3 - Proceedings of the International Conference on Parallel Processing Workshops
SP - 181
EP - 189
BT - Proceedings - 45th International Conference on Parallel Processing Workshops, ICPPW 2016
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 45th International Conference on Parallel Processing Workshops, ICPPW 2016
Y2 - 16 August 2016 through 19 August 2016
ER -