There is a newer version of the record available.

Published August 6, 2025 | Version 2025.8.0
Software Open

TensorZero

Authors/Creators

Description

New Features

  • Skip ClickHouse migration workflow on gateway startup when the migration table is up to date. This change reduces the startup time of the gateway.
  • Support raw_text content blocks in the OpenAI-compatible inference endpoint. (Thanks @hongantran3804 @pykm05 @pycoder49!)
  • Allow users to collect outputs from "Try with variant" in the UI as demonstrations.

Bug Fixes

  • Fix handling of reasoning content blocks for DeepSeek R1 on AWS Bedrock.
  • Set proper default value for max_tokens for the Anthropic and GCP Vertex AI Anthropic model providers. The gateway will now error if no value is provided in the configuration or request and the model is unknown.
  • Skip caching model inferences that generated invalid tool call arguments.

& many under-the-hood and UI improvements (thanks @michaldorsett @K-coder05 @dcaputo-harmoni @masonblier @Nicolasgarbarino!)

Notes

If you use this software, please cite it as below.

Files

tensorzero/tensorzero-2025.8.0.zip

Files (44.4 MB)

Name Size Download all
md5:fbaf0b3e50b146f84b2904b9cd697850
44.4 MB Preview Download

Additional details

Related works