Published February 27, 2024 | Version v1
Dataset Open

HarmBench Results (1.0)

Description

Notes:

- To save space, we do not include log files for the text behavior results. Please let us know if you would like the results with logs (including intermediate test cases and losses)

- A small fraction of test cases have not finished generating due to issues with certain models. We will update these as soon as possible. In the meantime, these results can be used to run most comparisons.

- To print out ASR tables with these results, you can use https://github.com/centerforaisafety/HarmBench/blob/main/notebooks/analyze_results.ipynb

Files

harmbench_results_initial_release.zip

Files (10.4 GB)

Name Size Download all
md5:ac0e8210389b81951f66da6daaa6db3b
10.4 GB Preview Download

Additional details

Dates

Available
2024-02-26