Inspect AI: Framework for Large Language Model Evaluations

Inspect is a fully open-source, extensible framework for rigorous evaluation of large language models (LLMs). It enables comprehensive, reproducible assessments across a broad range of task domains—including coding, reasoning, knowledge, agentic tasks, behaviour, and multimodal understanding—supported by extensive tooling, over 100 pre-built benchmarks, and visualisation utilities. Inspect is designed to provide an excellent developer experience while enabling evaluations that can be reproducibly run at scale.