TensorZero

[!CAUTION] Breaking Changes

• Moving forward, explicit tensorzero::params will take precedence over conflicting native parameters when using the OpenAI-compatible inference endpoint.

[!WARNING] Planned Deprecations

• Rename json_mode="implicit_tool" to json_mode="tool".
• Set model_name and optionally provider_name instead of model_provider_name in extra_body and extra_headers objects supplied at inference time. Alternatively, don't include a scope filter at all.

New Features

• Support Anthropic's Beta Structured Outputs feature natively (beta_structured_outputs). extra_headers is no longer necessary.
• Support json_mode="tool" in chat inferences that don't otherwise include tools.
• Support extra_body and extra_headers supplied at inference time without scope filters.
• Support extra_body and extra_headers supplied at inference time with model_name and optional provider_name scope filters.
• Support thought signatures for the GCP Vertex model providers.
• Support custom tools for the OpenAI model provider.
• Add description fields to evaluation and evaluator configuration.

& multiple under-the-hood and UI improvements