Published October 17, 2026 | Version 1.0.3

Auditing policy dependent benchmarks in allocation simulations

Authors/Creators

  • 1. Independent researcher, Berlin

Description

When an allocation policy changes which agents remain in a queue, a benchmark built from the best agent present at each decision changes with the policy. A ratio against that benchmark can then rise while total value falls, or fall while it rises. In a two-period housing example, the moving-benchmark ratio rises from 0.80 to 1.00 while realised value falls from 16 to 11. In a deadline queue with an exact offline optimum, value rises from 19 to 27 while the ratio falls from 1.00 to 0.90. I provide a routine that reports numerator and denominator changes against a fixed reference. This note has been merged into the paper When the Benchmark Moves with the Policy (version 7.0 of the Execution-Certainty Wedge record), which supersedes it. Version 1.0.3 adds, in policyspace2_audit/, the instrumentation patch, analysis script and per-seed results of the PolicySpace2 audit reported in When the Benchmark Moves with the Policy; the earlier files are unchanged. Revision details are in revision_notes.md.

Files

Auditing_policy_dependent_benchmarks_v1_0_2.pdf

Files (1.8 MB)

Name Size
md5:ac54ff15095ab29d58f5a0bf1cba9dff
294.7 kB Download
md5:19a719c45f87749823be62413ced61f2
424.6 kB Preview Download
md5:a4d10c2a7142b2a64784ac4c3fb12b7e
1.1 MB Preview Download
md5:9d18e2599483a2302921930af04d1078
2.7 kB Download
md5:d4fc55cccdcafddacfc96c79c2f22c9f
7.3 kB Download
md5:b267e914e757cb2250cb0b86334bb912
2.3 kB Preview Download
md5:8e7410edc3aa3d11fc24c1e37b324ee5
13.5 kB Preview Download
md5:2437654895c06deaf9b78a317570c7aa
673 Bytes Preview Download

Additional details

Related works

Is derived from
Preprint: 10.5281/zenodo.22164073 (DOI)