Skip to main navigation Skip to search Skip to main content

Stork: Making data placement a first class citizen in the grid

  • University of Wisconsin-Madison

Research output: Contribution to conferencePaperpeer-review

200 Scopus citations

Abstract

Todays scientific applications have huge data requirements which continue to increase drastically every year. These data are generally accessed by many users from all across the the globe. This implies a major necessity to move huge amounts of data around wide area networks to complete the computation cycle, which brings with it the problem of efficient and reliable data placement. The current approach to solve this problem of data placement is either doing it manually, or employing simple scripts which do not have any automation or fault tolerance capabilities. Our goal is to make data placement activities first class citizens in the Grid just like the computational jobs. They will be queued, scheduled, monitored, managed, and even check-pointed. More importantly, it will be made sure that they complete successfully and without any human interaction. We also believe that data placement jobs should be treated differently from computational jobs, since they may have different semantics and different characteristics. For this purpose, we have developed Stork, a scheduler for data placement activities in the Grid.

Original languageEnglish
Pages342-349
Number of pages8
DOIs
StatePublished - 2004
EventProceedings - 24th International Conference on Distributed Computing Systems - Hachioji, Tokyo, Japan
Duration: Mar 24 2004Mar 26 2004

Conference

ConferenceProceedings - 24th International Conference on Distributed Computing Systems
Country/TerritoryJapan
CityHachioji, Tokyo
Period03/24/0403/26/04

Fingerprint

Dive into the research topics of 'Stork: Making data placement a first class citizen in the grid'. Together they form a unique fingerprint.

Cite this