Published April 2, 2026 | Version 2026.4.0
Software Open

TensorZero

Authors/Creators

Description

New Features

  • Add an MCP server to the gateway exposing its API in /mcp.
  • Report provider prompt caching statistics via API and UI.
  • Report usage statistics (e.g. tokens, latency, cost) for inference evaluations via CLI tool, API, and UI.
  • Add the Prometheus metrics tensorzero_input_tokens_total and tensorzero_output_tokens_total.
  • Add configuration field content_type_overrides to handle file inputs for long-tail providers.

& multiple under-the-hood and UI improvements

Notes

If you use this software, please cite it as below.

Files

tensorzero/tensorzero-2026.4.0.zip

Files (28.9 MB)

Name Size Download all
md5:b0575ba14112af5e7005bb0f615f1a69
28.9 MB Preview Download

Additional details

Related works

Is supplement to
Software: https://github.com/tensorzero/tensorzero/tree/2026.4.0 (URL)

Software

Repository URL
https://github.com/tensorzero/tensorzero