Published April 3, 2014
| Version v1
Dataset
Open
Robot List OA-Statistics
Description
Standard Robot Exclusion List
used by OA-Statistics. Compilation of some popular black-list.
Status of this document
This document represents a consensus of the german project OA-Statistik. It is not an official standard backed by a standards body, or owned by any commercial organisation. It is not enforced by anybody, and there no guarantee that all current and future robots will use it. It has also been open for discussion.
Files
OA-Statistics_Robot_List_2014.md
Files
(47.1 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:5869c5af58c4046775dca87dc464ddc9
|
47.1 kB | Preview Download |