TensorZero

[!CAUTION] Breaking Changes

• This release includes small breaking changes to the programmatic observability/dataset APIs (e.g. list_datapoints, experimental_list_inferences) and the underlying data schema. Moving forward, TensorZero will store and return the new format for text ({"type": "text", "text": "..."}), template ({"type": "template", "name": "...", "arguments": { ... }}), and file ({"type": "file", "file_type": "...", ...}) content blocks. Note: These changes do not affect the inference APIs or the legacy data stored in ClickHouse.

[!WARNING] Completed Deprecations

• The TensorZero Helm chart will no longer support the legacy gateway ingress. The createLegacyIngress variable was removed. Moving forward, the only supported gateway ingress is tensorzero-gateway.

Bug Fixes

• Fix an issue that prevented comments from being rendered in the workflow evaluation UI.

New Features

• Add HTTP endpoint for querying datapoints by ID (POST /v1/datasets/get_datapoints).
• Add HTTP endpoint for querying datapoints with filters (POST /v1/datasets/{dataset_name}/list_datapoints).
• Add HTTP endpoint for creating datapoints from inferences (POST /v1/datasets/{dataset_id}/from_inferences).
• Add HTTP endpoint for updating datapoints (PATCH /v1/{dataset_name}/datapoints).
• Add HTTP endpoint for updating datapoint metadata (PATCH /v1/datasets/{dataset_name}/datapoints/metadata).
• Add HTTP endpoint for deleting datapoints (DELETE /v1/datasets/{dataset_id}/datapoints).
• Add HTTP endpoint for deleting datasets (DELETE /v1/datasets/{dataset_id}).
• Enable users to create, update, and delete messages and content blocks in the dataset editor in the UI.
• Emit OpenTelemetry spans for rate limiting queries.
• Add support for deployment service accounts in the Helm chart (thanks @jinnovation!).
• Add support for dynamic extra attributes for OTLP spans (TensorZero-OTLP-Traces-Extra-Attribute-*).

& multiple under-the-hood and UI improvements