Dataset Open Access

Claim Detection and Matching for Indian Languages

Ashkan Kazemi; Kiran Garimella; Devin Gaffney; Scott A. Hale

Two datasets are included in this repository: claim matching and claim detection datasets. The collections contain data in 5 languages: Bengali, English, Hindi, Malayalam and Tamil.

The "claim detection" dataset contains textual claims from social media and fact-checking websites annotated for the  "fact-check worthiness" of the claims in each message. Data points have one of the three labels of "Yes" (text contains one or more check-worthy claims), "No" and "Probably". 

The "claim matching" dataset is a curated collection of pairs of textual claims from social media and fact-checking websites for the purpose of automatic and multilingual claim matching. Pairs of data have one of the four labels of "Very Similar", "Somewhat Similar", "Somewhat Dissimilar" and "Very Dissimilar".

All personally identifiable information (PII) including phone numbers, email addresses, license plate numbers and addresses have been replaced with general tags (e.g. <PHONE#>, <ADDRESS>, etc) to protect user anonymity. A detailed explanation on the curation and annotation process is provided in our ACL 2021 paper: 
Kazemi, A.; Garimella, K.; Gaffney, D.; and Hale, S. A. 2021. Claim Matching Beyond English to Scale Global Fact-Checking. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics, ACL 2021.

Files (7.3 MB)
Name Size
claim_detection_dataset.csv
md5:55206b1786829a5a1d31ecb2e69da090
3.1 MB Download
claim_matching_dataset.csv
md5:0088a150cb6c9ef5fbc4a59cbd4aeb88
4.1 MB Download
283
187
views
downloads
All versions This version
Views 283283
Downloads 187187
Data volume 603.4 MB603.4 MB
Unique views 257257
Unique downloads 152152

Share

Cite as