Show simple item record

dc.contributor.authorKosar, Tevfiken_US
dc.contributor.authorKola, Georgeen_US
dc.contributor.authorLivny, Mironen_US
dc.date.accessioned2012-03-15T17:17:31Z
dc.date.available2012-03-15T17:17:31Z
dc.date.created2003en_US
dc.date.issued2003
dc.identifier.citationTR1487en_US
dc.identifier.urihttp://digital.library.wisc.edu/1793/60366
dc.description.abstractThe drastic increase in the data requirements of scientific applications combined with an increasing trend towards collaborative research has resulted in the need to transfer large amounts of data among the participating sites. The heterogeneous nature of the storage systems employed by the different sites makes transfer of data among them a difficult problem. The general tendency has been to either use simple scripts which require human intervention to deal with failures, or dump data to tapes and mail them. We introduce a method to build and operate data-pipelines between mass-storage systems lacking a common interface. This method can be applied easily and efficiently to transfer data between various mass storage systems. It does not need any human intervention during transfers, and it can recover automatically from various kinds of storage system, network, and software failures, guaranteeing completion of the transfers.en_US
dc.format.mimetypeapplication/pdfen_US
dc.publisherUniversity of Wisconsin-Madison Department of Computer Sciencesen_US
dc.titleBuilding Data-Pipelines for High Performance Bulk Data Transfers in a Heterogeneous Grid Environmenten_US
dc.typeTechnical Reporten_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

  • CS Technical Reports
    Technical Reports Archive for the Department of Computer Sciences at the University of Wisconsin-Madison

Show simple item record