Review of Anthropic's "Risks from Automated R&D" Section: A Detection Engineering Analysis of an AI Safety Policy Document
Description
This working paper examines a document published by METR on November 5, 2026, which reviews the "Risks from automated R&D" section of Anthropic's public August 2026 Risk Report. The review was conducted as part of a high-access assessment in which Anthropic shared a private version of the report alongside extensive non-public data. METR agrees with Anthropic that catastrophic risks from models available by July 15th were low, but argues it is plausible that an early warning threshold, the 2x Acceleration Threshold, had already been crossed. The document debates benchmark methodology, counterfactual acceleration estimation, and the interpretation of capability metrics such as AECI and unnamed leading indicators. From a detection engineering standpoint, this document contains no security content. It describes no attacker behaviour, no intrusion technique, no observable adversary action, and no security telemetry. The only rule produced is a null rule confirming that no applicable detection source exists. This paper explains why the document was routed to a detection queue erroneously, what a defender cannot see from this class of material, and what limitations apply to any analysis built solely from the provided source text.
Working draft 0.1, machine drafted. Companion detection content is in saluca-labs/detection-content under Apache-2.0.
Notes
Files
detection-content-2026-11-review-of-the-risks-from-autom-source.zip
Additional details
Related works
- Is derived from
- Report: https://metr.org/blog/2026-11-05-rd-section-anthropic-risk-report-august-2026-review/ (URL)
- Is supplemented by
- Software: https://github.com/saluca-labs/detection-content (URL)