Kharisara/mer-jit-llm-fgcs: Final Reproducibility Artifact for Array Submission
Authors/Creators
Description
ReplayBench-PG v2.5.2
Final reproducibility artifact accompanying the Array manuscript:
ReplayBench-PG: A Fault-Aware Deterministic Replay Benchmarking Framework for Policy-Gated Multimodal AI Pipelines
This release provides the exact implementation, datasets, pretrained policy, benchmark configurations, generated evaluation artifacts, and validation scripts used for the submitted manuscript.
Validation Status
This release has been fully validated using the built-in artifact validator.
Validation summary:
- All required artifact files present
- Comment 12 traceability validation passed
- Comment 13 environment comparison validation passed
- Primary benchmark validation passed
- Timing study validation passed
- Ray validation passed
- Controlled fault validation passed
- MetroPT-3 secondary validation passed
- Cross-region cloud validation passed
- Python compilation passed (113 files)
- Test suite passed (29/29)
Running
python run_final_artifact_validation.py
produces
[DONE] Final ReplayBench-PG validation passed
Repository Contents
The release includes:
- ReplayBench-PG framework
- deterministic replay engine
- policy-gated execution pipeline
- pretrained behavioural-cloning policy
- replay workloads
- benchmark configuration files
- generated benchmark outputs
- cloud validation evidence
- controlled fault validation evidence
- MetroPT-3 secondary validation
- timing study
- reproducibility manifests
- final manuscript tables
- validation scripts
- automated test suite
Reproducing the Validation
python -m venv .venv
Activate the environment and install dependencies:
pip install -r requirements.txt
Run:
python run_final_artifact_validation.py
Expected result:
[DONE] Final ReplayBench-PG validation passed
Citation
If you use ReplayBench-PG in academic work, please cite the associated Array manuscript.
MIT License.
Files
Kharisara/mer-jit-llm-fgcs-v2.5.2.zip
Additional details
Related works
- Is supplement to
- Software: https://github.com/Kharisara/mer-jit-llm-fgcs/tree/v2.5.2 (URL)
Software
- Repository URL
- https://github.com/Kharisara/mer-jit-llm-fgcs