TensorZero

[!CAUTION] Breaking Changes

• The --config-file globbing behavior has changed: single-level wildcards (*) no longer match files across directory boundaries. To match files across directory boundaries, use recursive wildcards (**). This aligns the behavior with standard glob semantics. For example:
  • --config-file *.toml matches tensorzero.toml, but not subdir/tensorzero.toml.
  • --config-file **/*.toml matches both tensorzero.toml and subdir/tensorzero.toml.

[!WARNING] Completed Deprecations

• Removed deprecated legacy endpoints for dataset management. The functionality is fully covered by the new endpoints.

New Features

• Add cost tracking and cost-based rate limiting.
• Add namespaces: the ability to set up multiple granular experiments (A/B tests) for the same TensorZero function.
• Improve reasoning support for Anthropic (including adaptive thinking), Fireworks AI, SGLang, and Together AI.
• Allow users to whitelist automatic tool approvals for TensorZero Autopilot.
• Report provider errors when include_raw_response is enabled.
• Add include_aggregated_response to streaming inferences. When enabled, the final chunk includes an aggregated output aggregated_response that combines previous chunks.
• Allow users to kill ongoing evaluation runs from UI.
• Allow custom gateway bind addresses with the environment variable TENSORZERO_GATEWAY_BIND_ADDRESS.

& multiple under-the-hood and UI improvements (thanks @Nfemz @greg80303)!