TensorZero

[!CAUTION] Breaking Changes

• LLM judges used to perform chain-of-thought reasoning by default (including for chat_completion variants). This is now opt-in via the new experimental_chain_of_thought variant type.
• The --format human_readable flag for the evaluations binary was renamed to --format pretty.

New Features

• Add experimental_chain_of_thought variant type.
• Enable users to provide manual feedback to inferences, episodes, and evaluations in the UI.
• Support inference caching with OpenAI-compatible inference endpoint.
• Add an example integrating LangGraph and TensorZero.

& multiple under-the-hood and UI improvements (thanks @oliverbarnes @subham73!)