Skip to main navigation Skip to search Skip to main content

Run-time adaptation of grid data placement jobs

  • University of Wisconsin-Madison

Research output: Contribution to journalArticlepeer-review

13 Scopus citations

Abstract

Grid presents a continuously (hanging environment. It also introduces a new set of failures. The data grid initiative has made it possible to run data-intensive applications on the grid. Data-intensive grid applications consist of two parts: a data placement part and a computation part. The data placement part is responsible for transferring the input data to the compute node and the result of the computation to the appropriate storage system. While work has been done on making computation adapt to changing conditions, little work has been done on making the data placement adapt to changing conditions. In this work, we have developed an infrastructure which observes the environment and enables run-time adaptation of data placement jobs. We have enabled Stork, a scheduler for data placement jobs in heterogeneous environments like the grid, to use this infrastructure and adapt the data placement job to the environment just before execution. We have also added dynamic protocol selection and alternate protocol fall-back capability to Stork to provide superior performance and fault tolerance.

Original languageEnglish
Pages (from-to)33-43
Number of pages11
JournalScalable Computing
Volume6
Issue number3
StatePublished - 2005

Keywords

  • Condor
  • Data intensive applications
  • Data placement
  • Dynamic protocol selection
  • Grid
  • Run-time adaptation
  • Scheduling
  • Stork

Fingerprint

Dive into the research topics of 'Run-time adaptation of grid data placement jobs'. Together they form a unique fingerprint.

Cite this