TensorZero

[!CAUTION] Breaking Changes

• The default value for cache_options.enabled changed from write_only to off.

New Features

• Support reasoning models from Groq, Mistral, and vLLM.
• Support multi-turn reasoning with Gemini and OpenAI-compatible models.
• Support embedding models from Together AI.
• Add configurable total_ms timeout to streaming inferences.
• Display charts with top-k evaluation results in the TensorZero Autopilot UI.
• Add "Ask Autopilot" buttons throughout the UI.
• Allow TensorZero Autopilot to edit your local configuration files.
• Return thought and unknown content blocks in the OpenAI-compatible endpoint (tensorzero_extra_content).

& multiple under-the-hood and UI improvements!