TensorZero

[!CAUTION]

Breaking Changes

• The bug fix for feedback_id technically introduces a breaking change in the TensorZero Python SDK. The field is no longer incorrectly doubly nested and now matches the SDK's type annotations.

[!WARNING] Completed Deprecations

• json_mode is now required for JSON function variants.

Bug Fixes

• Added workarounds for two ClickHouse regressions (ClickHouse/ClickHouse#86415, ClickHouse/ClickHouse#86557) introduced in ClickHouse 25.8. Replicated self-hosted clusters are still affected by ClickHouse/ClickHouse#86434. Pin to 25.7 or earlier if you run a replicated cluster. Single-node self-hosted deployments and ClickHouse Cloud are not affected.
• Fixed a bug in the TensorZero Python SDK that caused feedback_id to be doubly nested in feedback responses.
• Fixed a logging issue where models were incorrectly reported as "not found" in the embedding endpoint even on success.
• Fixed a bug where pending insertions could be dropped during shutdown when gateway.observability.batch_writes.enabled = true.
• Fixed a bug in the dynamic in-context learning (DICL) recipe and programmatic API. The gateway automatically detects problematic examples and logs a warning with resolution instructions if necessary.

New Features

• Added a throughput chart to the function detail page in the TensorZero UI.
• Support exporting OpenTelemetry spans for the feedback endpoint.
• Added recipes for supervised fine-tuning with torchtune and axolotl.
• Added examples for using the embedding endpoint with Azure OpenAI Service and OpenAI-compatible providers like Ollama (thanks @slbotbm!).
• Updated the DICL recipe to use TensorZero's new embedding API.
• Added support for caching embeddings (thanks @ishbir!).

& multiple under-the-hood and UI improvements (thanks @contrun @jinnovation!)