Published June 23, 2026
| Version v0.1.0
Dataset
Open
RIV-Bench: Remediation Intent Verification Benchmark
Description
A reproducible benchmark for verifying whether an automated infrastructure-as-code remediation satisfies a compliance control's intent rather than merely passing a syntactic linter. Includes a labeled fixture set across openly available frameworks (CIS AWS/Azure/GCP, SOC 2), JSON Schemas for cases and control-intent predicates, metric definitions, and a naive lint-only baseline that exposes the silent lint-pass-but-intent-unmet failure class. The benchmark is method-neutral and does not include any proprietary verification engine or requirement corpus.
Notes
Files
complyform/remediation-intent-benchmark-v0.1.0.zip
Additional details
Related works
- Is supplement to
- Software: https://github.com/complyform/remediation-intent-benchmark/tree/v0.1.0 (URL)
Software
- Repository URL
- https://github.com/complyform/remediation-intent-benchmark