A Twitter Dataset of 40+ million tweets related to COVID-19
Description
Due to the relevance of the COVID-19 global pandemic, we are releasing our dataset of tweets acquired from the Twitter Stream related to COVID-19 chatter. The first 9 weeks of data (from January 1st, 2020 to March 11th, 2020) contain very low tweet counts as we filtered other data we were collecting for other research purposes, however, one can see the dramatic increase as the awareness for the virus spread. Dedicated data gathering started from March 11th to March 22nd which yielded over 4 million tweets a day.
The data collected from the stream captures all languages, but the higher prevalence are: English, Spanish, and French. We release all tweets and retweets on the full_dataset.tsv file (40,823,816 unique tweets), and a cleaned version with no retweets on the full_dataset-clean.tsv file (7,479,940 unique tweets). There are several practical reasons for us to leave the retweets, tracing important tweets and their dissemination is one of them. For NLP tasks we provide the top 1000 frequent terms in frequent_terms.csv, the top 1000 bigrams in frequent_bigrams.csv, and the top 1000 trigrams in frequent_trigrams.csv. Some general statistics per day are included for both datasets in the statistics-full_dataset.tsv and statistics-full_dataset-clean.tsv files.
More details can be found (and will be updated faster at: https://github.com/thepanacealab/covid19_twitter)
As always, the tweets distributed here are only tweet identifiers (with date and time added) due to the terms and conditions of Twitter to re-distribute Twitter data. The need to be hydrated to be used.
Notes
Files
frequent_bigrams.csv
Files
(1.8 GB)
Name | Size | Download all |
---|---|---|
md5:2d45b4fa0704e5ad8833f32620ed1733
|
19.6 kB | Preview Download |
md5:cf22046acb6e1b51bedc8de36a7f2833
|
11.9 kB | Preview Download |
md5:c810eb0e9bbbd35e13de684947983a85
|
25.2 kB | Preview Download |
md5:bf4f5e5ea3c27da397c83bbabcdee948
|
286.1 MB | Download |
md5:9f376c690363289587a8681ea69e2107
|
1.6 GB | Download |
md5:6a3e65339b3790032520aca7100cfbf3
|
1.1 kB | Download |
md5:aad7b0a2ff6d605b5a6da2077b53180e
|
1.2 kB | Download |