Published August 16, 2026
| Version 1.1.0
Software
Open
LLM-as-a-Judge Cost Calculator: Five-Platform Cost Model
Description
A dependency-free browser calculator that estimates monthly judge-model inference and observability-platform costs from explicit workload inputs. Version 1.1.0 covers five observability platforms and twelve public plans, with source-linked pricing registries verified on 2026-08-13. It keeps application traces, sampled telemetry, evaluated traces, judge calls, stored scores, observations, bytes, and retention separate. Unsupported overages return not_computable or a lower bound instead of an invented estimate. The release includes calculation tests, methodology, and a static GitHub Pages application. Results are planning estimates, not vendor quotes.
Notes
Files
PharosProduction/llm-as-a-judge-cost-calculator-v1.1.0.zip
Files
(133.3 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:bf4b0c5e26b092f1661f57bbbe8f4d18
|
133.3 kB | Preview Download |
Additional details
Related works
- Is supplement to
- Journal article: https://pharosproduction.com/insights/engineering/llm-observability-cost/ (URL)
- Is supplemented by
- Software: https://pharosproduction.github.io/llm-as-a-judge-cost-calculator/ (URL)