HOPE: A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems

Yi Luo; D. Manivannan

doi:10.1016/j.future.2012.03.012

HOPE: A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems

Yi Luo
, D. Manivannan

Computer Science

Producción científica: Article › revisión exhaustiva

16 Citas (Scopus)

Resumen

Future generation supercomputers will be message-passing distributed systems consisting of hundreds of thousands of processors. As the size of the system grows, failure rate increases. Hence for the success and deployability of such large scale systems, scalable checkpointing and recovery protocols need to be implemented. Existing checkpointing and rollback recovery protocols used for providing fault tolerance in distributed systems are not scalable to such large systems. In this paper, we address this important and timely issue and propose a scalable group-based Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging (HOPE) protocol. Performance evaluation indicates, our protocol takes a balanced approach to lower checkpointing and message logging overhead and enhances scalability.

Idioma original	English
Páginas (desde-hasta)	1217-1235
Número de páginas	19
Publicación	Future Generation Computer Systems
Volumen	28
N.º	8
DOI	https://doi.org/10.1016/j.future.2012.03.012
Estado	Published - oct 2012

Nota bibliográfica

Funding Information:
Dr. Manivannan is a recipient of the Faculty CAREER Award from the US National Science Foundation. He is a senior member of the IEEE and a senior member of the ACM.

Funding Information:
This material is based in part upon work supported by the US National Science Foundation under Grant No. IIS-0414791 . Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The authors thank the editor and the reviewers, for their valuable and constructive comments which helped greatly in improving the content and presentation of the paper.

Financiación

Dr. Manivannan is a recipient of the Faculty CAREER Award from the US National Science Foundation. He is a senior member of the IEEE and a senior member of the ACM. This material is based in part upon work supported by the US National Science Foundation under Grant No. IIS-0414791 . Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The authors thank the editor and the reviewers, for their valuable and constructive comments which helped greatly in improving the content and presentation of the paper.

Financiadores
US National Science Foundation
National Science Foundation (NSF)

ASJC Scopus subject areas

Software
Hardware and Architecture
Computer Networks and Communications

Acceder al documento

10.1016/j.future.2012.03.012

Otros archivos y enlaces

Citar esto

@article{12cfd7555978452fa30e40d0bd9c44ef,

title = "HOPE: A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems",

abstract = "Future generation supercomputers will be message-passing distributed systems consisting of hundreds of thousands of processors. As the size of the system grows, failure rate increases. Hence for the success and deployability of such large scale systems, scalable checkpointing and recovery protocols need to be implemented. Existing checkpointing and rollback recovery protocols used for providing fault tolerance in distributed systems are not scalable to such large systems. In this paper, we address this important and timely issue and propose a scalable group-based Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging (HOPE) protocol. Performance evaluation indicates, our protocol takes a balanced approach to lower checkpointing and message logging overhead and enhances scalability.",

keywords = "Checkpointing protocols, Consistent global checkpoint, Failure recovery in distributed systems, Fault tolerance, Large scale systems, Message logging protocols",

author = "Yi Luo and D. Manivannan",

note = "Funding Information: Dr. Manivannan is a recipient of the Faculty CAREER Award from the US National Science Foundation. He is a senior member of the IEEE and a senior member of the ACM. Funding Information: This material is based in part upon work supported by the US National Science Foundation under Grant No. IIS-0414791 . Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The authors thank the editor and the reviewers, for their valuable and constructive comments which helped greatly in improving the content and presentation of the paper. ",

year = "2012",

month = oct,

doi = "10.1016/j.future.2012.03.012",

language = "English",

volume = "28",

pages = "1217--1235",

number = "8",

}

TY - JOUR

T1 - HOPE

T2 - A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems

AU - Luo, Yi

AU - Manivannan, D.

N1 - Funding Information: Dr. Manivannan is a recipient of the Faculty CAREER Award from the US National Science Foundation. He is a senior member of the IEEE and a senior member of the ACM. Funding Information: This material is based in part upon work supported by the US National Science Foundation under Grant No. IIS-0414791 . Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The authors thank the editor and the reviewers, for their valuable and constructive comments which helped greatly in improving the content and presentation of the paper.

PY - 2012/10

Y1 - 2012/10

N2 - Future generation supercomputers will be message-passing distributed systems consisting of hundreds of thousands of processors. As the size of the system grows, failure rate increases. Hence for the success and deployability of such large scale systems, scalable checkpointing and recovery protocols need to be implemented. Existing checkpointing and rollback recovery protocols used for providing fault tolerance in distributed systems are not scalable to such large systems. In this paper, we address this important and timely issue and propose a scalable group-based Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging (HOPE) protocol. Performance evaluation indicates, our protocol takes a balanced approach to lower checkpointing and message logging overhead and enhances scalability.

AB - Future generation supercomputers will be message-passing distributed systems consisting of hundreds of thousands of processors. As the size of the system grows, failure rate increases. Hence for the success and deployability of such large scale systems, scalable checkpointing and recovery protocols need to be implemented. Existing checkpointing and rollback recovery protocols used for providing fault tolerance in distributed systems are not scalable to such large systems. In this paper, we address this important and timely issue and propose a scalable group-based Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging (HOPE) protocol. Performance evaluation indicates, our protocol takes a balanced approach to lower checkpointing and message logging overhead and enhances scalability.

KW - Checkpointing protocols

KW - Consistent global checkpoint

KW - Failure recovery in distributed systems

KW - Fault tolerance

KW - Large scale systems

KW - Message logging protocols

UR - https://www.scopus.com/pages/publications/84862234608

UR - https://www.scopus.com/pages/publications/84862234608#tab=citedBy

U2 - 10.1016/j.future.2012.03.012

DO - 10.1016/j.future.2012.03.012

M3 - Article

AN - SCOPUS:84862234608

SN - 0167-739X

VL - 28

SP - 1217

EP - 1235

JO - Future Generation Computer Systems

JF - Future Generation Computer Systems

IS - 8

ER -

HOPE: A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems

Resumen

Nota bibliográfica

Financiación

ASJC Scopus subject areas

Acceder al documento

Otros archivos y enlaces

Huella

Citar esto