WebCloak: Characterizing and Mitigating Threats from LLM-Driven Web Agents as Intelligent Scrapers

This repository contains the artifact for the paper "WebCloak: Characterizing and Mitigating the Threats of LLM-Driven Web Agents as Intelligent Scrapers". Our work presents the first systematic characterization of LLM-driven web agents as intelligent scrapers and introduces WebCloak, an effective defense mechanism.

Note: our LLMCrawlBench dataset is at https://zenodo.org/records/17251212.