Published June 23, 2026 | Version v0.1.0

RIV-Bench: Remediation Intent Verification Benchmark

Authors/Creators

  • 1. ComplyForm LLC

Description

A reproducible benchmark for verifying whether an automated infrastructure-as-code remediation satisfies a compliance control's intent rather than merely passing a syntactic linter. Includes a labeled fixture set across openly available frameworks (CIS AWS/Azure/GCP, SOC 2), JSON Schemas for cases and control-intent predicates, metric definitions, and a naive lint-only baseline that exposes the silent lint-pass-but-intent-unmet failure class. The benchmark is method-neutral and does not include any proprietary verification engine or requirement corpus.

Notes

Fixtures use only openly available frameworks; no proprietary control content is included. Add the NSF award number under 'grants' once funded.

Files

complyform/remediation-intent-benchmark-v0.1.0.zip

Files (33.5 kB)

Name Size
md5:a463dd529587de1b197ce0127cf41607
33.5 kB Preview Download

Additional details