There is a newer version of the record available.

Published March 15, 2026 | Version v1

Librarian Catches Thief: Surfacing Supply Chain Attack Campaigns via Document Similarity in an AI Agent Skill Registry

  • 1. ROR icon Edgewood University

Description

AI agent skill marketplaces distribute natural-language instruction files following the Agent Skills standard, an open format adopted by over 30 platforms. Unlike code registries such as npm and PyPI, no marketplace examined in this study performs documented deduplication or similarity checking at ingest. In early 2026, the ClawHub registry for the OpenClaw agent framework experienced a supply chain attack campaign in which threat actors uploaded hundreds of near-identical skills that directed users to install credential-stealing malware.

A MinHash locality-sensitive hashing pipeline processed 31,634 skill files from the ClawHub registry and 31 community repositories with no security-specific tuning. At a 90% Jaccard threshold, 7,147 files fell into 2,622 similarity clusters, and all 337 known malicious skills present in the corpus appeared in a cluster. Among the 38 clusters containing at least 10 files, 30 held confirmed malicious content (78.9%, 95% CI [63.7, 88.9]), and every cluster with more than 20 files was malicious (95% CI [74.1, 100]).

Document similarity clustering has proven effective in code registries; these results show the technique transfers to text-based ecosystems where campaigns reuse templates at scale. Git commit history suggests that the largest campaign had already formed a detectable cluster in the archive by the time of public disclosure, under conservative assumptions about disclosure timing. These results support the use of document similarity as a lightweight, signature-free first pass for publish-time security screening in text-based registries.

Notes (English)

Erratum (2026-07-11). Reference 32 in this version misstates the title and author list of the cited work. The intended reference is: 

R. Zhang, H. Wang, J. Wang, M. Li, Y. Huang, D. Wang, and Q. Wang, "From Allies to Adversaries: Manipulating LLM Tool-Calling through Adversarial Injection," NAACL 2025, pp. 2009–2028. https://doi.org/10.18653/v1/2025.naacl-long.101

The claim attributed to this reference in the text, including the venue and reported success rates, is accurate as written. The reference is corrected in the next version of this record.

Files

main-arxiv.pdf

Files (350.7 kB)

Name Size
md5:e53d86350ef6519c5790c5c8185a352f
350.7 kB Preview Download

Additional details

Software

Repository URL
https://github.com/galeep/plugin-librarian
Programming language
Python
Development Status
Active