Skip to main navigation Skip to search Skip to main content

Phoenix: Making data-intensive grid applications fault-tolerant

  • University of Wisconsin-Madison

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Scopus citations

Abstract

A major hurdle facing data intensive grid applications is the appropriate handling of failures that occur in the grid-environment. Implementing the fault-tolerance transparently at the grid-middleware level would make different data intensive applications fault-tolerant without each having to pay a separate cost and reduce the time to grid-based solution for many scientific problems. We analyzed the failures encountered by four real-life production data intensive applications: NCSA image processing pipeline, WCER video processing pipeline, US-CMS pipeline and BMRB BLAST pipeline. Taking the result of the analysis into account, we have designed and implemented Phoenix, a transparent middleware-level fault-tolerance layer that detects failures early, classifies failures into transient and permanent and appropriately handles the transient failures. We applied our fault-tolerance layer to a prototype of the NCSA image processing pipeline and considerably improved the failure handling and report on the insights gained in the process.

Original languageEnglish
Title of host publicationProceedings - Fifth IEEE/ACM International Workshop on Grid Computing
PublisherIEEE Computer Society
Pages251-258
Number of pages8
ISBN (Print)0769522564
DOIs
StatePublished - 2004
Event5th IEEE/ACM International Workshop on Grid Computing, GRID 2004 - Pittsburgh, PA, United States
Duration: Nov 8 2004Nov 8 2004

Publication series

NameProceedings - IEEE/ACM International Workshop on Grid Computing
ISSN (Print)1550-5510

Conference

Conference5th IEEE/ACM International Workshop on Grid Computing, GRID 2004
Country/TerritoryUnited States
CityPittsburgh, PA
Period11/8/0411/8/04

Fingerprint

Dive into the research topics of 'Phoenix: Making data-intensive grid applications fault-tolerant'. Together they form a unique fingerprint.

Cite this