From f1e4242cbfbb89ac9478d36ee191f2fef928074f Mon Sep 17 00:00:00 2001 From: Ishaan Jaffer Date: Sat, 22 Nov 2025 17:18:10 -0800 Subject: [PATCH] docs fix --- .../release_notes/v1.80.5-stable/index.md | 71 +++++++++---------- 1 file changed, 35 insertions(+), 36 deletions(-) diff --git a/docs/my-website/release_notes/v1.80.5-stable/index.md b/docs/my-website/release_notes/v1.80.5-stable/index.md index 67a360fadb..d207de97f4 100644 --- a/docs/my-website/release_notes/v1.80.5-stable/index.md +++ b/docs/my-website/release_notes/v1.80.5-stable/index.md @@ -48,9 +48,12 @@ pip install litellm==1.80.5 - **Prompt Management** - Full prompt versioning support with UI for editing, testing, and version history - **MCP Hub** - Publish and discover MCP servers within your organization - **Model Compare UI** - Side-by-side model comparison interface for testing -- **Gemini 3w** - Day-0 support with thought signatures in Responses API -- **Azure GPT-5.1 Models** - Complete Azure GPT-5.1 family support with EU region pricing -- **Performance Improvements** - Realtime endpoint optimizations and SSL context caching +- **Gemini 3** - Day-0 support for Gemini 3 models with thought signatures +- **Batch API Spend Tracking** - Granular spend tracking with custom metadata for batch and file creation requests +- **AWS IAM Secret Manager** - IAM role authentication support for AWS Secret Manager +- **Logging Callback Controls** - Admin-level controls to prevent callers from disabling logging callbacks in compliance environments +- **Proxy CLI JWT Authentication** - Enable developers to authenticate with the proxy CLI using JWTs +- **Batch API Routing** - Route batch and file operations to specific models and deployments --- @@ -81,6 +84,35 @@ This update reduces `/realtime` latency by removing redundant encodings on the h --- +## Model Compare UI + +New interactive playground UI enables side-by-side comparison of multiple LLM models, making it easy to evaluate and compare model responses. + +**Features:** +- Compare responses from multiple models in real-time +- Side-by-side view with synchronized scrolling +- Support for all LiteLLM-supported models +- Cost tracking per model +- Response time comparison +- Pre-configured prompts for quick and easy testing + +**Details:** + +- **Parameterization**: Configure API keys, endpoints, models, and model parameters, as well as interaction types (chat completions, embeddings, etc.) + +- **Model Comparison**: Compare up to 3 different models simultaneously with side-by-side response views + +- **Comparison Metrics**: View detailed comparison information including: + + - Time To First Token + - Input / Output / Reasoning Tokens + - Total Latency + - Cost (if enabled in config) + +- **Safety Filters**: Configure and test guardrails (safety filters) directly in the playground interface + +[Get Started with Model Compare](../../docs/proxy/model_compare_ui) - [PR #16855](https://github.com/BerriAI/litellm/pull/16855) + ## New Providers and Endpoints ### New Providers @@ -255,9 +287,7 @@ This update reduces `/realtime` latency by removing redundant encodings on the h - Edit add callbacks route to use data from backend - [PR #16699](https://github.com/BerriAI/litellm/pull/16699) - **Usage & Analytics** - - Organization Usage in Usage Tab - [PR #16614](https://github.com/BerriAI/litellm/pull/16614) - Allow partial matches for user ID in User Table - [PR #16952](https://github.com/BerriAI/litellm/pull/16952) - - Docs for Model Compare UI and Org Usage - [PR #16928](https://github.com/BerriAI/litellm/pull/16928) - **General UI** - Allow setting base_url in API reference docs - [PR #16674](https://github.com/BerriAI/litellm/pull/16674) @@ -408,37 +438,6 @@ This update reduces `/realtime` latency by removing redundant encodings on the h --- -## Model Compare UI - -New interactive playground UI enables side-by-side comparison of multiple LLM models, making it easy to evaluate and compare model responses. - -**Features:** -- Compare responses from multiple models in real-time -- Side-by-side view with synchronized scrolling -- Support for all LiteLLM-supported models -- Cost tracking per model -- Response time comparison -- Pre-configured prompts for quick and easy testing - -**Details:** - -- **Parameterization**: Configure API keys, endpoints, models, and model parameters, as well as interaction types (chat completions, embeddings, etc.) - -- **Model Comparison**: Compare up to 3 different models simultaneously with side-by-side response views - -- **Comparison Metrics**: View detailed comparison information including: - - - Time To First Token - - Input / Output / Reasoning Tokens - - Total Latency - - Cost (if enabled in config) - -- **Safety Filters**: Configure and test guardrails (safety filters) directly in the playground interface - -[Get Started with Model Compare](../../docs/proxy/model_compare_ui) - [PR #16855](https://github.com/BerriAI/litellm/pull/16855) - ---- - ## New Contributors * @mattmorgis made their first contribution in [PR #16371](https://github.com/BerriAI/litellm/pull/16371)