Published May 17, 2023 | Version v1
Conference paper Open

On Data Processing through the Lenses of S3 Object Lambda

  • 1. Universitat Rovira i Virgili

Description

Despite that Function-as-a-Service (FaaS) has settled down as one of the fundamental cloud programming models, it is still evolving quickly. Recently, Amazon has introduced S3 Object Lambda, which allows a user-defined function to be automatically invoked to process an object as it is being downloaded from S3. As with any new feature, careful study thereof is the key to elucidate if S3 Object Lambda, or more generally, if inline serverless data processing, is a valuable addition to the cloud. For this reason, we conduct an extensive measurement study of this novel service, in order to characterize its architecture and performance (in terms of coldstart latency, TTFB times, and more). We particularly put an eye on the streaming capabilities of this new form of function, as it may open the door to empower existing serverless systems with stream processing capacities. We discuss the pros and cons of this new capability through several workloads, concluding that S3 Object Lambda can go far beyond its original purpose and be leveraged as a building block for more complex abstractions.

Files

On_Data_Processing_through_the_Lenses_of_S3_Object_Lambda.pdf

Files (1.4 MB)

Additional details

Funding

European Commission
CloudSkin - Adaptive virtualization for AI-enabled Cloud-edge Continuum 101092646
European Commission
NEARDATA - Extreme Near-Data Processing Platform 101092644