Published August 5, 2020 | Version v1

Japanese Sample Tweets, COVID-19 Keywords and Emotions from 2020-01-01 to 2020-06-30 (88,495,817 tweets and 47,539,139 retweets)

Authors/Creators

  • 1. Toyohashi University of Technology

Description

Data

Tweets_YYYY-MM.tsv.gz:
The first column is the tweet id, the second column is the date and time (JST) when the tweet was posted, the third column is the tweet id of the mention destination, the fourth column is the tweet id of the retweet source, the fifth column is the place id, the sixth column is the country code, the seventh column is the prefecture code if the country code is JP, and the eighth column is the COVID-19-related keyword included in the tweet. Columns with no information are empty. For example, a tweet with an empty eighth column is not a COVID-19-related tweet.
This data was collected using statuses/sample of the Twitter Streaming API, narrowed down by language=ja. Therefore, most of the tweets are Japanese tweets. Also, due to a failure of the data collection server, a large number of tweets on January 22 are missing :(
We have used 肺炎, コロナ and COVID (case insensitive) as keywords related to COVID-19.

Emotions_YYYY-MM.tsv.gz:
The first column is the tweet id, the second and subsequent columns are the number of occurrences of each emotional keyword. Column names (types of emotion) are shown in the first row.
We used mlask43-simple (Perl implementation of ML-Ask) with dictionaries used in pymlask to extract emotional keywords from the tweet.

Publication

This data set was created for my study. If you make use of this data set, please cite:
Mitsuo Yoshida. The State of Social Media During the COVID-19 Pandemic: Japan's Situation, Research Trends and Public Datasets. Journal of Japanese Society for Artificial Intelligence (in Japanese). vol.35, no.5, pp.644-653, 2020.
吉田光男. COVID-19流行下におけるソーシャルメディア ―日本での状況と研究動向・公開データセット―. 人工知能. vol.35, no.5, pp.644-653, 2020.

Files

Files (2.8 GB)

Name Size
md5:b3c83b71ddb87e9813e3adebba460ba9
149.5 MB Download
md5:9324771ec6e9257de6d67b6be935d18e
147.7 MB Download
md5:b18f23e1303fd022d2791bc6aba14000
170.7 MB Download
md5:3ee1dab4579bbabff43569e56eba12f1
175.9 MB Download
md5:fc5bfc7c0e5a8b3f3b26f1e046b28f84
185.4 MB Download
md5:83a0b717a8597c7c7a67355265819fb3
163.9 MB Download
md5:ba7c816c64af4d007e9f6b9973a03c68
276.5 MB Download
md5:5f7aa7b93ef92eb35e74a44005e62634
274.1 MB Download
md5:b76cb6c890a80bc8c0ad37665af4ad79
317.5 MB Download
md5:5b5d7e5fe4717a850d20e1df4c279754
330.0 MB Download
md5:23886f0441cf29969a8a643c9f16d7d1
346.3 MB Download
md5:6c66bb7a78964c635f3c6198e7acb647
305.3 MB Download