There is a newer version of this record available.

Dataset Open Access

A Twitter Dataset of 100+ million tweets related to COVID-19

Banda, Juan M.; Tekumalla, Ramya; Wang, Guanyu; Yu, Jingyuan; Liu, Tuo; Ding, Yuning; Chowell, Gerardo


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">eng</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">social media</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">twitter</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">nlp</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">covid-19</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">covid19</subfield>
  </datafield>
  <controlfield tag="005">20210719174049.0</controlfield>
  <datafield tag="500" ind1=" " ind2=" ">
    <subfield code="a">This dataset will be updated bi-weekly at least with additional tweets, look at the github repo for these updates</subfield>
  </datafield>
  <controlfield tag="001">3735274</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Georgia State University</subfield>
    <subfield code="0">(orcid)0000-0002-1606-4856</subfield>
    <subfield code="a">Tekumalla, Ramya</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Missouri</subfield>
    <subfield code="a">Wang, Guanyu</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Universitat Autònoma de Barcelona</subfield>
    <subfield code="a">Yu, Jingyuan</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Carl von Ossietzky Universität Oldenburg</subfield>
    <subfield code="a">Liu, Tuo</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Universität Duisburg-Essen</subfield>
    <subfield code="a">Ding, Yuning</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Georgia State University</subfield>
    <subfield code="0">(orcid)0000-0003-2194-2251</subfield>
    <subfield code="a">Chowell, Gerardo</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">20290</subfield>
    <subfield code="z">md5:46c5785e0683f33265f53785ce4ac907</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/frequent_bigrams.csv</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">12575</subfield>
    <subfield code="z">md5:b183370e5c8436a991ad64403ba8a656</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/frequent_terms.csv</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">26703</subfield>
    <subfield code="z">md5:0cbd251ebd0158bd7e166b9313549376</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/frequent_trigrams.csv</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">161776043</subfield>
    <subfield code="z">md5:37842638f49e241d9f93ae59e5e89655</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/full_dataset-clean.tsv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">718260843</subfield>
    <subfield code="z">md5:fc49928446e93a63db18e78d3718ba55</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/full_dataset.tsv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1406</subfield>
    <subfield code="z">md5:123df6f3f8d446202371487da7b871aa</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/statistics-full_dataset-clean.tsv</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1480</subfield>
    <subfield code="z">md5:c30bb2fd51c9b35f6dd0993f90367f8e</subfield>
    <subfield code="u">https://zenodo.org/record/3735274/files/statistics-full_dataset.tsv</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2020-03-31</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">user-zenodo</subfield>
    <subfield code="p">user-covid-19</subfield>
    <subfield code="p">user-biohackathon</subfield>
    <subfield code="o">oai:zenodo.org:3735274</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Georgia State University</subfield>
    <subfield code="0">(orcid)0000-0001-8499-824X</subfield>
    <subfield code="a">Banda, Juan M.</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">A Twitter Dataset of 100+ million tweets related to COVID-19</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-biohackathon</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-covid-19</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-zenodo</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="a">Other (Public Domain)</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;&lt;strong&gt;Due to the relevance of the COVID-19 global pandemic, we are releasing our dataset of tweets acquired from the Twitter Stream related to COVID-19 chatter. The first 9 weeks of data (from January 1st, 2020 to March 11th, 2020) contain very low tweet counts as we filtered other data we were collecting for other research purposes, however, one can see the dramatic increase as the awareness for the virus spread. Dedicated data gathering started from March 11th to March 30th&amp;nbsp;which yielded over 4 million tweets a day. We have added additional data provided by our new collaborators from January 27th to February 27th, to provide extra longitudinal coverage.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;The data collected from the stream captures all languages, but the higher prevalence are:&amp;nbsp; English, Spanish, and French. We release all tweets and retweets on the full_dataset.tsv file (101,400,452 unique tweets), and a cleaned version with no retweets on the full_dataset-clean.tsv file (20,244,746 unique tweets). There are several practical reasons for us to leave the retweets, tracing important tweets and their dissemination is one of them. For NLP tasks we provide the top 1000 frequent terms in frequent_terms.csv, the top 1000 bigrams in frequent_bigrams.csv, and the top 1000 trigrams in frequent_trigrams.csv. Some general statistics per day are included for both datasets in the statistics-full_dataset.tsv and statistics-full_dataset-clean.tsv files.&amp;nbsp;&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;More details can be found (and will be updated faster at: &lt;a href="https://github.com/thepanacealab/covid19_twitter"&gt;https://github.com/thepanacealab/covid19_twitter&lt;/a&gt;)&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;As always, the tweets distributed here are only tweet identifiers (with date and time added) due to the terms and conditions of Twitter to re-distribute Twitter data. The need to be hydrated to be used. &lt;/strong&gt;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.3723939</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.3735274</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>
97,451
126,661
views
downloads
All versions This version
Views 97,4512,934
Downloads 126,661791
Data volume 182.7 TB170.9 GB
Unique views 76,3722,537
Unique downloads 25,713423

Share

Cite as