Contextual User-Centric Task Offloading for Mobile Edge Computing in Ultra-Dense Network

Integrating mobile edge computing (MEC) in ultra-dense network (UDN) is a key enabler to meet the service demand by allowing smart devices to perform uninterrupted task offloading via densely deployed MEC servers. In most cases, the smart devices randomly move around the whole network. Consequently, the popular "MEC-centralized decision" offloading approach could be inapplicable, as joint decision-making among multiple MEC servers becomes difficult due to time synchronization and information exchange overhead. In this paper, we take a user-centric approach to minimize a long-term delay for a given task duration under a price budget constraint. To address this problem, we develop a novel contextual sleeping bandit learning (CSBL) algorithm, which integrates contextual information and sleeping characteristic to accelerate the learning convergence and leverage Lyapunov optimization to deal with the price budget constraint. Furthermore, we extend to a multiple offloading scenario where multiple MEC servers can be selected in each offloading round and propose a CSBL-multiple (CSBL-M) algorithm to address the exponential increase of the offloading selections. For both CSBL and CSBL-M, we derive the upper bounds of learning regret and provide rigorous proofs that they asymptotically approach the Oracle algorithm within bounded deviations for finite task duration. Simulation results illustrate that our proposed algorithms significantly outperform existing algorithms in both single offloading and multiple offloading scenario.