ILION+SRM Benchmark v1: Session-Level Temporal Authorization Dataset and Reproducibility Artifacts
Authors/Creators
Description
V37 - This record contains the benchmark dataset and reproducibility artifacts accompanying the paper “Session Risk Memory (SRM) : Temporal Authorization for Deterministic Pre-Execution Safety Gates” - doi.org/10.5281/zenodo.19159580.
ILION-SRM-Bench v1 is a multi-turn benchmark designed to evaluate temporal authorization in agentic AI systems. It addresses a key limitation of stateless execution safety gates: the inability to detect distributed attacks that unfold across multiple individually compliant steps.
The dataset includes 80 sessions (40 benign, 40 attack) spanning three attack classes: slow exfiltration, privilege escalation, and compliance drift. Each session consists of structured action sequences compatible with ILION’s semantic evaluation space.
The package includes:
- session definitions (JSON)
- evaluation results (stateless ILION vs ILION+SRM)
- benchmark metrics and per-session verdicts
- visualization figures
- full documentation (README)
Results show that ILION+SRM eliminates false positives (FPR: 0%) while maintaining 100% detection rate, improving over stateless ILION (FPR: 5%, F1: 0.9756) to F1: 1.0000.
This record serves as the official benchmark and reproducibility artifact set for SRM and can be cited independently.
Files
ILION-SRM-Bench-v1-Data.zip
Files
(21.4 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:a0de158cebfc9c1e1735564bad1ff392
|
108.2 kB | Preview Download |
|
md5:8d61db878b73499c627b6fa94bdc0b12
|
155.6 kB | Preview Download |
|
md5:9b09f277855294b49e2f33bc0c3463ce
|
373.4 kB | Preview Download |
|
md5:0fcf6fc9dbdb73a27e3fa28dd025db5f
|
99.4 kB | Preview Download |
|
md5:ecc1d77731f64977530c2b27a0733ca0
|
189.5 kB | Preview Download |
|
md5:93ee9c69427a7ab7349a257a0696067f
|
139.0 kB | Preview Download |
|
md5:3e10e2ec21834b75b4ebad7f48cb8d7a
|
144.3 kB | Preview Download |
|
md5:20eb34aadec6eaa7479b81d2f09f55d8
|
109.9 kB | Preview Download |
|
md5:6415409877ae6c3e455c0e9a30b6081d
|
231.1 kB | Preview Download |
|
md5:7c6f0524bd53b84d035442d7cb5f1e3d
|
4.4 MB | Preview Download |
|
md5:93dec253687f6b67a9f597d4f76944d7
|
166.9 kB | Preview Download |
|
md5:f8b88ab7bd23dc4b6f0c818f68a7776d
|
201.9 kB | Preview Download |
|
md5:0451d985ad6c25197389a06b11d7f7f8
|
107.4 kB | Preview Download |
|
md5:b6dc408b708bf0d34f72f3892469a541
|
88.1 kB | Preview Download |
|
md5:87a604f51cd2cd2e49a7fbfdb1ca5796
|
4.4 MB | Preview Download |
|
md5:8f8a63cb418dc3634d15d683810c3fcc
|
77.3 kB | Preview Download |
|
md5:405bd7e30fd804e13ae2737ef33940d0
|
231.7 kB | Preview Download |
|
md5:b5a988b3225ce727e81d12a2c4b656bb
|
129.9 kB | Preview Download |
|
md5:826fdc08de6d51f1f147d53263d7b509
|
182.3 kB | Preview Download |
|
md5:1cc0c02377fe0987262c9c0fcf3fa045
|
205.2 kB | Preview Download |
|
md5:ad9ebf737c53905a02bfb3c21bfbe3c0
|
81.6 kB | Preview Download |
|
md5:e2f865d2a6cc09934d7f51d84056b5a8
|
94.7 kB | Preview Download |
|
md5:15baa2ab417d4fcaa36c1d22fca78d7a
|
707.2 kB | Preview Download |
|
md5:b0f2c5025feeddf6b7a8abf4c39d2389
|
315.3 kB | Preview Download |
|
md5:3ab0f249664f5ef6643da92b4ab02bc4
|
205.2 kB | Preview Download |
|
md5:d058c11cbe3b4d9631869d85bc6114de
|
746.9 kB | Preview Download |
|
md5:560be29254d2a890c0dfe21234800a1c
|
104.4 kB | Preview Download |
|
md5:89f9bc24691827c8e0f0a66a9c3acd60
|
149.5 kB | Preview Download |
|
md5:4d1c77243f09f378ea7eee0ab88f97fb
|
138.2 kB | Preview Download |
|
md5:03edb7f2b8b868f52666df42f4f7d1fc
|
310.3 kB | Preview Download |
|
md5:cedad996dcecb5ae775f61da4d415715
|
1.0 MB | Preview Download |
|
md5:dc641adcda632a522210c70795890ffe
|
4.4 MB | Preview Download |
|
md5:8fb5d15f181e9e6cf23dab79edf280af
|
120.9 kB | Preview Download |
|
md5:0bf5526992a4084418d9d95f5b21a656
|
428.3 kB | Preview Download |
|
md5:81a8c64fbcc2855f251cb2c120564e54
|
166.5 kB | Preview Download |
|
md5:82bf07456d1a27210486b3fab9b9a4c7
|
561.5 kB | Preview Download |
|
md5:6b7554176b6ad338bb04b66be34ab051
|
111.1 kB | Preview Download |
|
md5:da0fc451fa2840034dee47f30fe468bc
|
7.7 kB | Preview Download |
Additional details
Dates
- Submitted
-
2025