Published October 19, 2026 | Version v2

Reproducibility Materials for "Benchmark Integrity in Three COVID-19 and Mpox Misinformation Datasets: Duplicate Overlap, Cross-Dataset Contamination and Exploratory Label-Quality Signals."

  • 1. ROR icon Manchester Metropolitan University

Description

This reproducibility release accompanies the revised manuscript, Benchmark Integrity in Three COVID-19 and Mpox Misinformation Datasets: Duplicate Overlap, Cross-Dataset Contamination and Exploratory Label-Quality Signals.

The archive provides Python implementations and analytical outputs for evaluating exact and near-duplicate content, evaluation-partition overlap, cross-corpus textual contamination, cross-dataset classification transfer, repeated-seed cross-validation and exploratory out-of-fold label-quality indicators across COVID-19-FNIR, Constraint and an mpox veracity-based analytic subset.

The revised release includes five-seed model evaluation, bootstrap uncertainty estimation and a 2,000-replicate group-aware bootstrap analysis that accounts for observations sharing identical normalised texts.

The archive also contains saved predictions, machine-readable statistical results, figure files, software requirements and instructions for reproducing the analyses. Original third-party datasets are not redistributed. Data-source information and input-file checksums are provided to support independent verification.

Files

Reproducibility_Guide.pdf

Files (36.3 kB)

Name Size
md5:89697a56377659720d645e685c015253
1.7 kB Download
md5:f1c0a8086e00de3fd73feb46f390d39d
29.4 kB Preview Download
md5:0cc33d62925fc11aae683d41e09123c2
5.1 kB Preview Download
md5:4811db70f052fcd06310ad0ca9e06eb0
80 Bytes Preview Download

Additional details

Dates

Created
2026-10-19

Software

Programming language
Python
Development Status
Active