Published May 16, 2023 | Version Pre-print
Conference paper Open

Sequence Clock: A Dynamic Resource Orchestrator for Serverless Architectures

  • 1. School of Electrical and Computer Engineering, National Technical University of Athens

Description

Function-as-a-service (FaaS) represents the next frontier in the evolution of cloud computing being an emerging paradigm that removes the burden of configuration and management issues from users. This is achieved by replacing the well-established monolithic approach with graphs of standalone, small, stateless, event-driven components called functions. At the same time, from the cloud providers’ perspective, problems such as availability, load balancing and scalability need to be resolved without being aware of the functionality, behavior or resource requirements of their tenants’ code. However, in this context, functions’ containers coexist with others inside a host of finite resources, where a passive resource allocation technique does not guarantee a well-defined quality of service (QoS) in regards to time latency. In this paper, we present Sequence Clock, an expandable latency targeting tool that actively monitors serverless invocations in a cluster and offers execution of a sequential chain of functions, also known as pipelines or sequences, while achieving the targeted time latency. Two regulation methods were utilized, with one of them achieving up to 82% decrease in the severity of time violations and in some cases even eliminating them completely.

Files

IEEE_CLOUD_2022___Sequence_Clock__A_Dynamic_Resource_Orchestrator_for_Serverless_Architectures.pdf

Additional details

Funding

AIatEDGE – A secure and reusable Artificial Intelligence platform for Edge computing in beyond 5G Networks 101015922
European Commission