Athanasia: A user-transparent and fault-tolerant system for parallel applications

Hyungsoo Jung*, Hyuck Han, Heon Y. Yeom, Sooyong Kang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

This article presents Athanasia, a user-transparent and fault-tolerant system, for parallel applications running on large-scale cluster systems. Cluster systems have been regarded as a de facto standard to achieve multitera-flop computing power. These cluster systems, as we know, have an inherent failure factor that can cause computation failure. The reliability issue in parallel computing systems, therefore, has been studied for a relatively long time in the literature, and we have seen many theoretical promises arise from the extensive research. However, despite the rigorous studies, practical and easily deployable fault-tolerant systems have not been successfully adopted commercially. Athanasia is a user-transparent checkpointing system for a fault-tolerant Message Passing Interface (MPI) implementation that is primarily based on the sync-and-stop protocol. Athanasia supports three critical functionalities that are necessary for fault tolerance: a light-weight failure detection mechanism, dynamic process management that includes process migration, and a consistent checkpoint and recovery mechanism. The main features of Athanasia are that it does not require any modifications to the application code and that it preserves many of the high performance characteristics of high-speed networks. Experimental results show that Athanasia can be a good candidate for practically deployable fault-tolerant systems in very-large and high-performance clusters and that its protocol can be applied to a variety of parallel communication libraries easily.

Original languageEnglish
Article number5710900
Pages (from-to)1653-1668
Number of pages16
JournalIEEE Transactions on Parallel and Distributed Systems
Volume22
Issue number10
DOIs
Publication statusPublished - 2011
Externally publishedYes

Keywords

  • ch-p4
  • fault tolerance
  • InfiniBand
  • message passing interface
  • Myrinet
  • parallel systems
  • User transparency

Fingerprint Dive into the research topics of 'Athanasia: A user-transparent and fault-tolerant system for parallel applications'. Together they form a unique fingerprint.

Cite this