Published March 25, 2021 | Version v2
Dataset Open

Data pipeline Validation And Load Testing using Multiple CSV Files

Authors/Creators

  • 1. Research Fellow, University of Tartu
  • 2. Masters Student, University of Tartu
  • 3. Lecturer, University of Tartu

Contributors

Project leader:

  • 1. Research Fellow, University of Tartu
  • 2. Masters Student, University of Tartu
  • 3. Lecturer, University of Tartu

Description

The datasets were used to validate and test the data pipeline deployment following the RADON approach. The dataset has a CSV file that contains around 32000 Twitter tweets. 100 CSV files have been created from the single CSV file and each CSV file containing 320 tweets. Those 100 CSV files are used to validate and test (performance/load testing) the data pipeline components. 

 


 

Files

DatapipelinePerformanceTestingWithMultipleCSVFiles.zip

Files (1.5 MB)

Additional details

Funding

European Commission
RADON - Rational decomposition and orchestration for serverless computing 825040