Modeling and optimizing transport-support workflows in high-performance networks

Daqing Yun, Qishi Wu, Patrick Brown, Mengxia Zhu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

High-performance networking technologies and services are being rapidly developed and deployed across the nation and around the globe to support the transfer of large data sets generated by next-generation scientific applications for collaborative data processing, analysis, and storage. However, these networking technologies and services have not been fully utilized mainly because their use often requires considerable domain knowledge and many application users are even not aware of their existence. The main goal of our work is to provide end users an integrated solution to discovering system and network resources and composing end-to-end paths for large data transfer. By leveraging the resource discovery capability previously developed in Network-Aware Data Movement Advisor (NADMA), we propose novel profiling and modeling approaches to characterize various types of resources that are available in end systems, edge segments, and backbone networks, taking into consideration a comprehensive set of performance metrics and network parameters in different phases including device deployment, circuit setup, and data transfer. Based on these profiles and models, we formulate a class of transport-support workflow optimization problems where an appropriate set of technologies and services are selected to compose the best transport-support workflow to meet the user's data transfer request in terms of various performance requirements. We conduct wide-area network experiments to validate the cost models and illustrate the efficacy of the proposed workflow-based transport solution.

Original languageEnglish
Title of host publicationProceedings of the 37th Annual IEEE Conference on Local Computer Networks, LCN 2012
Pages384-391
Number of pages8
DOIs
StatePublished - 1 Dec 2012
Event37th Annual IEEE Conference on Local Computer Networks, LCN 2012 - Clearwater, FL, United States
Duration: 22 Oct 201225 Oct 2012

Publication series

NameProceedings - Conference on Local Computer Networks, LCN

Other

Other37th Annual IEEE Conference on Local Computer Networks, LCN 2012
CountryUnited States
CityClearwater, FL
Period22/10/1225/10/12

Keywords

  • Service model
  • high-performance networking
  • performance modeling
  • workflow

Fingerprint Dive into the research topics of 'Modeling and optimizing transport-support workflows in high-performance networks'. Together they form a unique fingerprint.

  • Cite this

    Yun, D., Wu, Q., Brown, P., & Zhu, M. (2012). Modeling and optimizing transport-support workflows in high-performance networks. In Proceedings of the 37th Annual IEEE Conference on Local Computer Networks, LCN 2012 (pp. 384-391). [6423652] (Proceedings - Conference on Local Computer Networks, LCN). https://doi.org/10.1109/LCN.2012.6423652