Published January 29, 2022 | Version v1
Dataset Open

Multilingual MigrationsKB: A Mulitlingual Knowledge Base of Migration related annotated Tweets

Creators

  • 1. FIZ Karlsruhe, KIT Germany

Description

Multilingual MigrationskB (MGKB) is a mulitlingual extended version of English MGKB. The tweets geotagged with Geo location from 32 European Countries (Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, Iceland, Liechtenstein, Norway, Switzerland, the United Kingdom)  are extracted and filtered by 11 languages (English, French, Finnish, German, Greek, Dutch, Hungarian, Italian, Polish, Spain, Swedish). Metadata information about the tweets, such as Geo information (place name, coordinates, country code) are included. MGKB  contains sentiments, offensive and hate speeches, topics, hashtags, user mentions in RDF format. The schema of MGKB is an extension of TweetsKB for migration related information. Moreover, to associate and represent the potential economic and social factors driving the migration flows, the data from Eurostat  and FIBO ontology was used. To represent multilinguality, the CIDOC Conceptual Reference Model (CIDOC-CRM) is used. The extracted economic indicators, i.e., GDP Growth Rate, Total Unemployment Rate, Youth Unemployment Rate, Long-term Unemployment Rate and Income per househould, are connected with each tweet in RDF using geographical and temporal dimensions. 

For this version, the Multilingual MGKB is delivered separated by year. The extracted topic words are also published.

Code: https://github.com/migrationsKB/MRL

Please contact Yiyi Chen (yiyi.chen@partner.kit.edu) for pretrained models (Sentiment analysis/hate speech detection/ETM) if necessary.

 

 

Files

topic_words_de.json

Files (763.5 MB)

Name Size Download all
md5:7a0771b34598c6e98c490b7cd0ca7d23
9.0 MB Download
md5:2ef802eb9ce6502d4ab4a01017de7635
24.1 MB Download
md5:9ea9a23994f8ede75bd5bfbd9166798e
57.8 MB Download
md5:fca4780c4c14e80433e6ac720b9aeb43
95.9 MB Download
md5:c382d84cbdfdbc292c3d0d3dd349ece7
132.9 MB Download
md5:4a5f19c2830f2da0cefe36ca4f7f1eb3
182.5 MB Download
md5:10b5c4eab76e7b9203b4dc0cc9050fd2
47.4 MB Download
md5:68ac3668982756262c611dbd3481c1ff
88.5 MB Download
md5:cf87547cbd4265121e67452e9ff09668
125.4 MB Download
md5:040cbc21fcd8773560d22ef690416cd6
4.4 kB Preview Download
md5:ced6ba500ee598a7848c3cd6617206fc
6.9 kB Preview Download
md5:220d761e9bcd33640c6ede487454c1ec
14.1 kB Preview Download
md5:e42a78ec99c75e3564a508606273f7ed
10.9 kB Preview Download
md5:be686c5f95882e1af40b878f3bba8b31
2.5 kB Preview Download
md5:a6a00d0c411a031b098510951a4f5c32
13.0 kB Preview Download
md5:1ebc20ffa70d724b3c177bbf4b76dcd4
1.4 kB Preview Download
md5:4863b6711ca76e503ce8df18132e21b3
8.9 kB Preview Download
md5:e620604df766ebad36e3057dd25d4e98
4.2 kB Preview Download
md5:5db2519234a9933583b615467ae613bb
3.6 kB Preview Download
md5:58579a6041c37e2edb85dcb00cc021fc
2.1 kB Preview Download

Additional details

Funding

ITFLOWS – IT tools and methods for managing migration FLOWS 882986
European Commission