Published July 2025 | Version v1
Working paper Open

ClaimCatchers at SemEval-2025 Task 7: Sentence Transformers for Claim Retrieval

  • 1. Queen Mary University of London
  • 2. ROR icon National University of Distance Education

Description

Retrieving previously fact-checked claims from verified databases has become a crucial area of research in automated fact-checking, given the impracticality of manual verification of massive online content. To address this challenge, SemEval 2025 Task 7 focuses on multilingual previously fact-checked claim retrieval. This paper presents the experiments conducted for this task, evaluating the effectiveness of various sentence transformer models—ranging from 22M to 9B parameters—in conjunction with retrieval strategies such as nearest neighbor search and reranking techniques. Further, we explore the impact of learning context-specific text representation via finetuning these models. Our results demonstrate that smaller and medium-sized models, when optimized with effective finetuning and reranking, can achieve retrieval accuracy comparable to larger models, highlighting their potential for scalable and efficient misinformation detection.

Files

2025.semeval-1.63.pdf

Files (906.1 kB)

Name Size Download all
md5:b81f11c19955cb8067ebcd8a1e95b8d4
906.1 kB Preview Download

Additional details

Identifiers

ISBN
979-8-89176-273-2

Funding

European Commission
HYBRIDS - Hybrid Intelligence to monitor, promote and analyse transformations in good democracy practices 101073351

Dates

Available
2025-07