Efficient big data transfer using bandwidth reservation service in high-performance networks

Liudong Zuo, Michelle Zhu

Research output: Chapter in Book/Report/Conference proceedingChapterResearchpeer-review

Abstract

88Sheer volumes of data, now frequently termed as “big data,” are being generated from various emerging applications of large-scale simulations, scientific experiments, and global-scale communications. Such extremely large amounts of data are normally generated at one data center and then need to be transferred to distributed data centers for data storage and analysis, within which fast, predictable, and reliable data transfer with guaranteed performance has become crucial to ensure success. Fortunately, reserving bandwidth as needed along selected paths in high-performance networks (HPNs) has proved to be an effective way to satisfy the requirements of such high-demanding data transfer. In this chapter, we first present the introduction and background of bandwidth reservation service in HPNs for big data transfer along with the challenges. The related works, and concepts and mechanisms of bandwidth reservation strategies are provided in Section 5.2 and Section 5.3, respectively. We show our algorithm’s design and illustration through simple examples for easy comprehension in Section 5.4, and conclude our work in Section 5.5.

Original languageEnglish
Title of host publicationBig Data and Computational Intelligence in Networking
PublisherCRC Press
Pages87-106
Number of pages20
ISBN (Electronic)9781498784870
ISBN (Print)9781498784863
DOIs
StatePublished - 1 Jan 2017

Fingerprint

Data transfer
Network performance
Bandwidth
Data storage equipment
Communication
Big data
Experiments

Cite this

Zuo, L., & Zhu, M. (2017). Efficient big data transfer using bandwidth reservation service in high-performance networks. In Big Data and Computational Intelligence in Networking (pp. 87-106). CRC Press. https://doi.org/10.1201/b21278
Zuo, Liudong ; Zhu, Michelle. / Efficient big data transfer using bandwidth reservation service in high-performance networks. Big Data and Computational Intelligence in Networking. CRC Press, 2017. pp. 87-106
@inbook{15ba06ec16ca4c0f8c063d2f0bd29d08,
title = "Efficient big data transfer using bandwidth reservation service in high-performance networks",
abstract = "88Sheer volumes of data, now frequently termed as “big data,” are being generated from various emerging applications of large-scale simulations, scientific experiments, and global-scale communications. Such extremely large amounts of data are normally generated at one data center and then need to be transferred to distributed data centers for data storage and analysis, within which fast, predictable, and reliable data transfer with guaranteed performance has become crucial to ensure success. Fortunately, reserving bandwidth as needed along selected paths in high-performance networks (HPNs) has proved to be an effective way to satisfy the requirements of such high-demanding data transfer. In this chapter, we first present the introduction and background of bandwidth reservation service in HPNs for big data transfer along with the challenges. The related works, and concepts and mechanisms of bandwidth reservation strategies are provided in Section 5.2 and Section 5.3, respectively. We show our algorithm’s design and illustration through simple examples for easy comprehension in Section 5.4, and conclude our work in Section 5.5.",
author = "Liudong Zuo and Michelle Zhu",
year = "2017",
month = "1",
day = "1",
doi = "10.1201/b21278",
language = "English",
isbn = "9781498784863",
pages = "87--106",
booktitle = "Big Data and Computational Intelligence in Networking",
publisher = "CRC Press",

}

Zuo, L & Zhu, M 2017, Efficient big data transfer using bandwidth reservation service in high-performance networks. in Big Data and Computational Intelligence in Networking. CRC Press, pp. 87-106. https://doi.org/10.1201/b21278

Efficient big data transfer using bandwidth reservation service in high-performance networks. / Zuo, Liudong; Zhu, Michelle.

Big Data and Computational Intelligence in Networking. CRC Press, 2017. p. 87-106.

Research output: Chapter in Book/Report/Conference proceedingChapterResearchpeer-review

TY - CHAP

T1 - Efficient big data transfer using bandwidth reservation service in high-performance networks

AU - Zuo, Liudong

AU - Zhu, Michelle

PY - 2017/1/1

Y1 - 2017/1/1

N2 - 88Sheer volumes of data, now frequently termed as “big data,” are being generated from various emerging applications of large-scale simulations, scientific experiments, and global-scale communications. Such extremely large amounts of data are normally generated at one data center and then need to be transferred to distributed data centers for data storage and analysis, within which fast, predictable, and reliable data transfer with guaranteed performance has become crucial to ensure success. Fortunately, reserving bandwidth as needed along selected paths in high-performance networks (HPNs) has proved to be an effective way to satisfy the requirements of such high-demanding data transfer. In this chapter, we first present the introduction and background of bandwidth reservation service in HPNs for big data transfer along with the challenges. The related works, and concepts and mechanisms of bandwidth reservation strategies are provided in Section 5.2 and Section 5.3, respectively. We show our algorithm’s design and illustration through simple examples for easy comprehension in Section 5.4, and conclude our work in Section 5.5.

AB - 88Sheer volumes of data, now frequently termed as “big data,” are being generated from various emerging applications of large-scale simulations, scientific experiments, and global-scale communications. Such extremely large amounts of data are normally generated at one data center and then need to be transferred to distributed data centers for data storage and analysis, within which fast, predictable, and reliable data transfer with guaranteed performance has become crucial to ensure success. Fortunately, reserving bandwidth as needed along selected paths in high-performance networks (HPNs) has proved to be an effective way to satisfy the requirements of such high-demanding data transfer. In this chapter, we first present the introduction and background of bandwidth reservation service in HPNs for big data transfer along with the challenges. The related works, and concepts and mechanisms of bandwidth reservation strategies are provided in Section 5.2 and Section 5.3, respectively. We show our algorithm’s design and illustration through simple examples for easy comprehension in Section 5.4, and conclude our work in Section 5.5.

UR - http://www.scopus.com/inward/record.url?scp=85052703328&partnerID=8YFLogxK

U2 - 10.1201/b21278

DO - 10.1201/b21278

M3 - Chapter

SN - 9781498784863

SP - 87

EP - 106

BT - Big Data and Computational Intelligence in Networking

PB - CRC Press

ER -

Zuo L, Zhu M. Efficient big data transfer using bandwidth reservation service in high-performance networks. In Big Data and Computational Intelligence in Networking. CRC Press. 2017. p. 87-106 https://doi.org/10.1201/b21278