Co-scheduling of advance and immediate bandwidth reservations for inter-data center transfer

Aiqin Hou, Chase Q. Wu, Liudong Zuo, Dawei Quan, Yangyang Li, Michelle M. Zhu, Qiang Duan, Dingyi Fang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As scientific applications and business services increasingly migrate to clouds, big data of various types with different priorities need to be transferred between geographically distributed cloud-based data centers. It has become a critical task for Cloud Service Providers (CSP) to fully utilize the expensive bandwidth resources of the links connecting such data centers while guaranteeing users’ Quality of Experience (QoE). Most high-performance networks based on software-defined networking (SDN) provide the capability of advance bandwidth reservation. This paper focuses on the scheduling of multiple user requests of two different types with different priorities, namely, advance bandwidth reservation with a lower priority and immediate bandwidth reservation with a higher priority, to maximize the total satisfaction of user requests. We formulate this co-scheduling problem as a generic optimization problem, which is shown to be NP-complete. We design a heuristic algorithm to maximize the number of successfully scheduled requests and minimize the number of preempted advance reservation requests, while minimizing the completion time of each request. Extensive simulation results show that our scheduling scheme significantly outperforms greedy approaches in terms of user satisfaction degree.

Original languageEnglish
Title of host publicationProceedings of 6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019 - Held in conjunction with SC 2019
Subtitle of host publicationThe International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages25-35
Number of pages11
ISBN (Electronic)9781728166667
DOIs
StatePublished - Nov 2019
Event6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019 - Denver, United States
Duration: 17 Nov 201917 Nov 2019

Publication series

NameProceedings of 6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019 - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019
CountryUnited States
CityDenver
Period17/11/1917/11/19

Keywords

  • Bandwidth reservation
  • Big data transfer
  • High-performance networks
  • Quality of Experience
  • Software-defined networks

Fingerprint Dive into the research topics of 'Co-scheduling of advance and immediate bandwidth reservations for inter-data center transfer'. Together they form a unique fingerprint.

  • Cite this

    Hou, A., Wu, C. Q., Zuo, L., Quan, D., Li, Y., Zhu, M. M., Duan, Q., & Fang, D. (2019). Co-scheduling of advance and immediate bandwidth reservations for inter-data center transfer. In Proceedings of 6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019 - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 25-35). [08940328] (Proceedings of 6th Annual International Workshop on Innovating the Network for Data Intensive Science, INDIS 2019 - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INDIS49552.2019.00009