Published September 4, 2026 | Version v0.4.1

TruthBench

Description

TruthBench is a framework for meta-evaluating factuality metrics through controlled, graded perturbation of ground-truth answers. It ships alongside truthscore, an LLM+NLI factual-correctness metric implemented as a separate package and evaluated with TruthBench like any other metric.

Notes

If you use this software, please cite the paper below.

Files

GiovanniGatti/truthbench-v0.4.1.zip

Files (3.3 MB)

Name Size
md5:42f5f1453d08add659559d13abc9f78a
3.3 MB Preview Download

Additional details

Related works