Published May 12, 2026 | Version v1

Skill as Memory, Not Document: A Database-Native Substrate for Agent Skill Catalogs

Description

Current LLM agent skill systems use storage formats optimized for human editorial workflow: Anthropic Agent Skills stores skills as SKILL.md files with YAML frontmatter and Markdown body; Voyager persists agent-authored skills as Python files. These document-first conventions collapse human authoring format, retrieval metadata, and agent-consumed runtime body into a single artifact. As autonomous agent learning becomes a primary use case — skills written by agents at runtime, retrieved by agents at inference, scoring composed over agent-emitted outcome events — document-shape choices become operational baggage.

I frame the required shift as "skill as memory, not document" and characterize three recurring failure modes when document-first catalogs are used as agent memory substrates: (i) token burn from in-context structural metadata; (ii) slowdown from filesystem organization not optimized for retrieval; (iii) invalid-skill admission from YAML-parseable acceptance. I measure all three on a 5,000-skill corpus.

Results: (i) Full-catalog disclosure at 5,000 skills consumes 919,200 tokens, exceeding GPT-4 Turbo 128K and Claude 3.7 200K windows entirely; the substrate's top-K disclosure consumes 369 tokens, constant in catalog size. A controlled ablation attributes the per-query gap against optimized filesystem alternatives to ~36 tokens of YAML frontmatter overhead per retrieved skill. (ii) p50 retrieval latency 87.3 ms, p95 106.3 ms at 5,000-skill scale on single-node deployment. (iii) The substrate rejects 70 of 70 adversarially-malformed skills (0% admission rate) at write time; a document-only YAML-parseable admission policy baseline admits 68 of 70 (97% admission).

Contributions: the "skill as memory, not document" framing as a unifying lens for autonomous-learning substrate design; the three-failure-mode taxonomy and its empirical measurement at 5,000-skill scale on a public reproducible corpus; and an operational decomposition of substrate-level primitives a competent filesystem alternative would need to assemble. I do not claim YantrikDB is a new database architecture — all individual primitives it ships (typed records, vector index, append-only logs, schema validation, Raft replication) exist independently in prior work. I identify a category mismatch in document-first skill catalogs and demonstrate a database-native design pattern for agent-written skill memory.

Files

figure-token-cost.png

Files (434.5 kB)

Name Size Download all
md5:3e6f5eb64aee3d20d012cee36a4733f7
78.4 kB Preview Download
md5:a75b2a4e678fa60f185279c8244641de
7.0 kB Preview Download
md5:377aadb5f04e15dd62f3c7db3c0e72ce
17.6 kB Download
md5:080bcd8447480be9f589c842481f1b92
233 Bytes Preview Download
md5:a05c079a9fd3627aa1e47ac41c73ef61
6.0 kB Download
md5:4843c0eaf4df1081c6dec277dfc2aec3
9.3 kB Download
md5:5f1990786dafb533fb9ec43a7ef5c7c1
4.2 kB Preview Download
md5:f92a464df8e1ef09aaa6791ac3270c3d
252.6 kB Preview Download
md5:23b9488938db6ac82d7752848246b182
47.9 kB Preview Download
md5:1f4d386f7a237ebbcbe141ea08a41944
421 Bytes Preview Download
md5:ebe2a742aab23f866781fc3e069ebcdc
10.7 kB Download
md5:aab52eabce956fc569769666c8afd398
159 Bytes Preview Download

Additional details

Related works

Cites
Preprint: 10.5281/zenodo.18793952 (DOI)

Dates

Submitted
2026-05-11