Design, implementation and performance of fault-tolerant message passing interface (MPI)

Fault Tolerant MPI (FTMPI) enables fault tolerance to the MPICH [11]. FTMPI is a transparent fault-tolerant environment, based on synchronous checkpointing and restarting mechanism. FTYPI relies on non-multithreaded single process checkpointing library to checkpoint an application process. Global replicated System Controller and cluster node specific Node Controller monitors and controls check pointing and recovery activities of all MPI applications within the cluster. This paper details the architecture to provide fault tolerance mechanism for MPI based applications running on clusters and the performance of NAS parallel benchmarks and parallelized medium range weather forecasting models, P-T80 and P-T126. The architecture addresses the following issues also: Replicating System Controller to avoid single point offailure. Ensuring consistency of checkpoint files based on distributed two phase commit protocol. Robustfault detection hierarchy.