There is a newer version of the record available.

Published July 28, 2026 | Version v2.5.2

Kharisara/mer-jit-llm-fgcs: Final Reproducibility Artifact for Array Submission

Authors/Creators

Description

ReplayBench-PG v2.5.2

Final reproducibility artifact accompanying the Array manuscript:

ReplayBench-PG: A Fault-Aware Deterministic Replay Benchmarking Framework for Policy-Gated Multimodal AI Pipelines

This release provides the exact implementation, datasets, pretrained policy, benchmark configurations, generated evaluation artifacts, and validation scripts used for the submitted manuscript.

Validation Status

This release has been fully validated using the built-in artifact validator.

Validation summary:

  • All required artifact files present
  • Comment 12 traceability validation passed
  • Comment 13 environment comparison validation passed
  • Primary benchmark validation passed
  • Timing study validation passed
  • Ray validation passed
  • Controlled fault validation passed
  • MetroPT-3 secondary validation passed
  • Cross-region cloud validation passed
  • Python compilation passed (113 files)
  • Test suite passed (29/29)

Running

python run_final_artifact_validation.py

produces

[DONE] Final ReplayBench-PG validation passed

Repository Contents

The release includes:

  • ReplayBench-PG framework
  • deterministic replay engine
  • policy-gated execution pipeline
  • pretrained behavioural-cloning policy
  • replay workloads
  • benchmark configuration files
  • generated benchmark outputs
  • cloud validation evidence
  • controlled fault validation evidence
  • MetroPT-3 secondary validation
  • timing study
  • reproducibility manifests
  • final manuscript tables
  • validation scripts
  • automated test suite

Reproducing the Validation

python -m venv .venv

Activate the environment and install dependencies:

pip install -r requirements.txt

Run:

python run_final_artifact_validation.py

Expected result:

[DONE] Final ReplayBench-PG validation passed

Citation

If you use ReplayBench-PG in academic work, please cite the associated Array manuscript.

MIT License.

Files

Kharisara/mer-jit-llm-fgcs-v2.5.2.zip

Files (513.3 MB)

Name Size
md5:39628b1cdbcf0e06534f8042c7b22651
513.3 MB Preview Download

Additional details

Related works