SC is the International Conference for
High Performance Computing, Networking,
Storage and Analysis



SCHEDULE: NOV 12-18, 2011

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

You can also create your personal schedule on the SC11 app (Boopsie) on your smartphone. Simply select a session you want to attend and "add" it to your plan. Continue in this manner until you have created your own personal schedule. All your events will appear under "My Event Planner" on your smartphone.

Checkpointing strategies for parallel jobs

SESSION: Checkpointing Optimization

EVENT TYPE: Paper

TIME: 11:00AM - 11:30AM

AUTHOR(S):Marin Bougeret, Henri Casanova, Mikael Rabie, Yves Robert, Frédéric Vivien

ROOM:TCC 304

ABSTRACT:
This work provides a rigorous analysis of checkpointing strategies for minimizing expected job execution times on failure-prone platforms. We give the optimal solution for exponentially distributed failure inter-arrival times, for both sequential and parallel jobs. For non-exponentially distributed failures, we develop a dynamic programming algorithm to maximize the amount of work completed before the next failure, which provides a good heuristic for minimizing the expected execution time. We consider various models of job parallelism and of parallel checkpointing overhead. We present results from extensive simulation experiments assuming that failures follow Exponential or Weibull distributions, the latter being more representative of real-world systems. Our simulation results corroborate theoretical results, and show that our dynamic programming algorithm vastly outperforms previous solutions for Weibull failures. We also conduct simulation experiments based on failure logs of production clusters, which confirm the superiority of our approach for real-world clusters.

Chair/Author Details:

Marin Bougeret - ENS Lyon

Henri Casanova - University of Hawaii at Manoa

Mikael Rabie - ENS Lyon

Yves Robert - ENS Lyon

Frédéric Vivien - INRIA

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library

   Sponsors    ACM    IEEE