There is a newer version of the record available.

Published May 4, 2023 | Version ccgrid23
Conference paper Open

Towards a Multi-objective Scheduling Policy for Serverless-based Edge-Cloud Continuum

  • 1. Univ. Grenoble Alpes
  • 2. Univ. Grenoble Alpes, Ryax Technologies
  • 3. Ryax Technologies

Description

The cloud is extended towards the edge to form a computing continuum while managing resources’ heterogeneity.
The serverless technology simplified how to build cloud applications and use resources, becoming a driving force in consolidating the continuum with the deployment of small functions with short execution. However, the adaptation of serverless to the edge-cloud continuum brings new challenges mainly related to resource management and scheduling. Standard cloud scheduling policies are based on greedy algorithms that do not efficiently handle platforms’ heterogeneity nor deal with problems such as cold start delays. This work introduces a new scheduling policy that tries to address these issues. It is based on multi-objective optimization for data transfers and makespan while considering
heterogeneity. Using simulations that vary workloads, platforms, and heterogeneity levels, we study the system utilization, the trade-offs between the targets, and the impacts of considering platforms’ heterogeneity. We perform comparisons with a baseline inspired by a Kubernetes-based policy, representing greedy algorithms. Our experiments show considerable gaps between the efficiency of a greedy-based scheduling policy and a multi-objective-based one. The last outperforms the baseline by reducing makespan, data transfers, and system utilization by up to two orders of magnitudes in relevant cases for the edge-cloud continuum.

Notes

We provide the source code implementation of all the scheduling policies proposed in the paper, as well as the source code of the simulation experiments used to evaluate our approach. Then, the reader can (i) generate and reproduce the experiments described in the paper for both evaluated scheduling policies, (ii) reproduce the analysis presented in the paper, (iii) generate and run their own workloads, platforms, and experiments, (iv) modify and exploit the linear program that is the basis of our proposed scheduling policy, FOA, and (v) test of pre-designed scenarios.

Files

foa-a-multi-objective-scheduling-policy-for-serverless-CCGRID23.zip

Files (126.9 MB)

Additional details

Funding

European Commission
PHYSICS - Optimized hybrid space-time service continuum in FAAS 101017047
Agence Nationale de la Recherche
MIAI - MIAI @ Grenoble Alpes ANR-19-P3IA-0003