GReM: Dynamic SSD resource allocation in virtualized storage systems with heterogeneous IO workloads

Zhengyu Yang, Jianzhe Tai, Janki Bhimani, Jiayin Wang, Ningfang Mi, Bo Sheng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

29 Scopus citations

Abstract

In a shared virtualized storage system that runs VMs with heterogeneous IO demands, it becomes a problem for the hypervisor to cost-effectively partition and allocate SSD resources among multiple VMs. There are two straightforward approaches to solving this problem: equally assigning SSDs to each VM or managing SSD resources in a fair competition mode. Unfortunately, neither of these approaches can fully utilize the benefits of SSD resources, particularly when the workloads frequently change and bursty IOs occur from time to time. In this paper, we design a Global SSD Resource Management solution - GReM, which aims to fully utilize SSD resources as a second-level cache under the consideration of performance isolation. In particular, GReM takes dynamic IO demands of all VMs into consideration to split the entire SSD space into a long-term zone and a short-term zone, and cost-effectively updates the content of SSDs in these two zones. GReM is able to adaptively adjust the reservation for each VM inside the long-term zone based on their IO changes. GReM can further dynamically partition SSDs between the long- and short-term zones during runtime by leveraging the feedbacks from both cache performance and bursty workloads. Experimental results show that GReM can capture the cross-VM IO changes to make correct decisions on resource allocation, and thus obtain high IO hit ratio and low IO management costs, compared with both traditional and state-of-the-art caching algorithms.

Original languageEnglish
Title of host publication2016 IEEE 35th International Performance Computing and Communications Conference, IPCCC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509052523
DOIs
StatePublished - 17 Jan 2017
Event35th IEEE International Performance Computing and Communications Conference, IPCCC 2016 - Las Vegas, United States
Duration: 9 Dec 201611 Dec 2016

Publication series

Name2016 IEEE 35th International Performance Computing and Communications Conference, IPCCC 2016

Other

Other35th IEEE International Performance Computing and Communications Conference, IPCCC 2016
CountryUnited States
CityLas Vegas
Period9/12/1611/12/16

Keywords

  • Bursty Detection
  • Caching Algorithms
  • I/O Workload Characterization
  • Resource Allocation
  • Solid State Drives
  • Virtualized Storage Systems

Fingerprint Dive into the research topics of 'GReM: Dynamic SSD resource allocation in virtualized storage systems with heterogeneous IO workloads'. Together they form a unique fingerprint.

  • Cite this

    Yang, Z., Tai, J., Bhimani, J., Wang, J., Mi, N., & Sheng, B. (2017). GReM: Dynamic SSD resource allocation in virtualized storage systems with heterogeneous IO workloads. In 2016 IEEE 35th International Performance Computing and Communications Conference, IPCCC 2016 [7820658] (2016 IEEE 35th International Performance Computing and Communications Conference, IPCCC 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PCCC.2016.7820658