TensorZero

[!CAUTION] Breaking Changes

• The default value for fetch_and_encode_input_files_before_inference is changing from true to false. As a result, the gateway will no longer fetch input files before inference, but instead will fetch them in parallel with inference (for observability). In rare cases, this may cause the gateway to receive different input files than those received by model providers.

[!WARNING] Planned Deprecations

• Migrate file content blocks from untagged enums to tagged enums. Moving forward, you should provide a field type with a value of "url", "base64", or "object_storage". Untagged enums are still accepted for backwards compatibility but will be deprecated in 2026.2+.
• Rename the TensorZero Python SDK type InferenceFilterTreeNode to InferenceFilter for consistency with related types. Both types will be available as aliases until 2026.2+.

Bug Fixes

• Send a user agent when fetching input files to avoid restrictions from websites that require it (e.g. Wikimedia).

New Features

• Add a new endpoint for batch datapoint updates (PATCH /v1/{dataset_name}/datapoints).
• Expose thought summaries in the TensorZero Python SDK.
• Add additional semantic tags when exporting traces using the OpenInference format (thanks @jinnovation!)

& multiple under-the-hood and UI improvements