Skip to main navigation Skip to search Skip to main content

Hysteresis-based optimization of data transfer throughput

  • SUNY Buffalo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

The achievable throughput for a data transfer can be determined by a variety of factors such as network bandwidth, round trip time, background traffic, dataset size, and end system configuration. For the best-effort optimization of the transfer throughput, three application-layer transfer parameters pipelining, parallelism and concurrency have been actively used in the literature. However, it is highly challenging to identify the best combination of these parameter settings for a specific data transfer request. In this paper, we analyze historical data consisting of 70 Million file transfers; apply data mining techniques to extract the hidden relations among the parameters and the optimal throughput; and propose a novel approach based on hysteresis to predict the optimal parameter settings.

Original languageEnglish
Title of host publicationProceedings of NDM 2015
Subtitle of host publication5th International Workshop on Network-Aware Data Management - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450340373
DOIs
StatePublished - Nov 15 2015
Event5th International Workshop on Network-Aware Data Management, NDM 2015 - Held as part of the 27th ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2015 - Austin, United States
Duration: Nov 16 2014Nov 16 2014

Publication series

NameProceedings of NDM 2015: 5th International Workshop on Network-Aware Data Management - Held in conjunction with SC 2015: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference5th International Workshop on Network-Aware Data Management, NDM 2015 - Held as part of the 27th ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2015
Country/TerritoryUnited States
CityAustin
Period11/16/1411/16/14

Keywords

  • Data mining
  • Data transfer optimization
  • Highbandwidth networks
  • Hysteresis
  • Protocol tuning

Fingerprint

Dive into the research topics of 'Hysteresis-based optimization of data transfer throughput'. Together they form a unique fingerprint.

Cite this