Skill as Memory, Not Document: A Database-Native Substrate for Agent Skill Catalogs
Authors/Creators
Description
Current LLM agent skill systems use storage formats optimized for human editorial workflow: Anthropic Agent Skills stores skills as SKILL.md files with YAML frontmatter and Markdown body; Voyager persists agent-authored skills as Python files. These document-first conventions collapse human authoring format, retrieval metadata, and agent-consumed runtime body into a single artifact. As autonomous agent learning becomes a primary use case — skills written by agents at runtime, retrieved by agents at inference, scoring composed over agent-emitted outcome events — document-shape choices become operational baggage.
I frame the required shift as "skill as memory, not document" and characterize three recurring failure modes when document-first catalogs are used as agent memory substrates: (i) token burn from in-context structural metadata; (ii) slowdown from filesystem organization not optimized for retrieval; (iii) invalid-skill admission from YAML-parseable acceptance. I measure all three on a 5,000-skill corpus.
Results: (i) Full-catalog disclosure at 5,000 skills consumes 919,200 tokens, exceeding GPT-4 Turbo 128K and Claude 3.7 200K windows entirely; the substrate's top-K disclosure consumes 369 tokens, constant in catalog size. A controlled ablation attributes the per-query gap against optimized filesystem alternatives to ~36 tokens of YAML frontmatter overhead per retrieved skill. (ii) p50 retrieval latency 87.3 ms, p95 106.3 ms at 5,000-skill scale on single-node deployment. (iii) The substrate rejects 70 of 70 adversarially-malformed skills (0% admission rate) at write time; a document-only YAML-parseable admission policy baseline admits 68 of 70 (97% admission).
Contributions: the "skill as memory, not document" framing as a unifying lens for autonomous-learning substrate design; the three-failure-mode taxonomy and its empirical measurement at 5,000-skill scale on a public reproducible corpus; and an operational decomposition of substrate-level primitives a competent filesystem alternative would need to assemble. I do not claim YantrikDB is a new database architecture — all individual primitives it ships (typed records, vector index, append-only logs, schema validation, Raft replication) exist independently in prior work. I identify a category mismatch in document-first skill catalogs and demonstrate a database-native design pattern for agent-written skill memory.
Files
figure-token-cost.png
Files
(434.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:3e6f5eb64aee3d20d012cee36a4733f7
|
78.4 kB | Preview Download |
|
md5:a75b2a4e678fa60f185279c8244641de
|
7.0 kB | Preview Download |
|
md5:377aadb5f04e15dd62f3c7db3c0e72ce
|
17.6 kB | Download |
|
md5:080bcd8447480be9f589c842481f1b92
|
233 Bytes | Preview Download |
|
md5:a05c079a9fd3627aa1e47ac41c73ef61
|
6.0 kB | Download |
|
md5:4843c0eaf4df1081c6dec277dfc2aec3
|
9.3 kB | Download |
|
md5:5f1990786dafb533fb9ec43a7ef5c7c1
|
4.2 kB | Preview Download |
|
md5:f92a464df8e1ef09aaa6791ac3270c3d
|
252.6 kB | Preview Download |
|
md5:23b9488938db6ac82d7752848246b182
|
47.9 kB | Preview Download |
|
md5:1f4d386f7a237ebbcbe141ea08a41944
|
421 Bytes | Preview Download |
|
md5:ebe2a742aab23f866781fc3e069ebcdc
|
10.7 kB | Download |
|
md5:aab52eabce956fc569769666c8afd398
|
159 Bytes | Preview Download |
Additional details
Related works
- Cites
- Preprint: 10.5281/zenodo.18793952 (DOI)
Dates
- Submitted
-
2026-05-11