Published July 10, 2025
| Version v1
Poster
Open
Serverless Data Processing with Lithops
Authors/Creators
- 1. Universitat Rovira i Virgili, Tarragona, Spain
Contributors
- 1. SLB
- 2. Lawrence Berkeley National Laboratory
- 3. Aptos
- 4. Curvenote
- 5. Arm
- 6. Deloitte
- 7. University of Alabama in Huntsville
Description
Lithops enables users to seamlessly scale single-machine Python code across thousands of serverless functions on AWS Lambda, IBM Cloud Functions, and Google Cloud Functions—eliminating the need to manage clusters. It automates function deployment, dependency management, and data partitioning, allowing fast and scalable execution of tasks such as exploratory data analysis, Monte Carlo simulations, sentiment analysis, and hyperparameter tuning. By integrating directly with Jupyter notebooks, Lithops democratizes access to cloud-scale computing, making high-performance distributed processing accessible to any Python user.