A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing

Kai Jiang, Huan Zhou, Dawei Li, Xuxun Liu, Shouzhi Xu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Mobile Edge Computing (MEC) has emerged as a promising computing paradigm in 5G networks, which can empower User Equipments (UEs) with computation and energy resources offered by migrating workloads from the UEs to the MEC servers. Although the issues of computation offloading and resource allocation in MEC have been studied with different optimization objectives, they mainly investigate quasi-static system environments, without considering the different resource requirements and time-varying system conditions in a dynamic system. In this paper, we exploit a multi-user MEC system, and investigate the task execution scheme for dynamic joint optimization of offloading decision and resource assignment. Our objective is to minimize the energy consumption of all UEs, with considering the delay constraint as well as the dynamic resource requirements of heterogeneous computation tasks. Accordingly, we formulate the problem as a mixed integer non-linear programming problem (MINLP), and propose a value iteration based Reinforcement Learning (RL) approach, named Q-Learning, to obtain the optimal policy of computation offloading and resource allocation. Simulation results demonstrate that the proposed approach can significantly decrease UEs' energy consumption in different scenarios, compared with other baseline methods.

Original languageEnglish
Title of host publicationICCCN 2020 - 29th International Conference on Computer Communications and Networks
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728166070
DOIs
StatePublished - Aug 2020
Event29th International Conference on Computer Communications and Networks, ICCCN 2020 - Honolulu, United States
Duration: 3 Aug 20206 Aug 2020

Publication series

NameProceedings - International Conference on Computer Communications and Networks, ICCCN
Volume2020-August
ISSN (Print)1095-2055

Conference

Conference29th International Conference on Computer Communications and Networks, ICCCN 2020
CountryUnited States
CityHonolulu
Period3/08/206/08/20

Keywords

  • Computation Offloading
  • Energy Consumptions
  • Mobile Edge Computing
  • Q-Learning
  • Resource Allocation

Fingerprint Dive into the research topics of 'A Q-learning based Method for Energy-Efficient Computation Offloading in Mobile Edge Computing'. Together they form a unique fingerprint.

Cite this