diff --git a/docs/my-website/release_notes/v1.72.2/index.md b/docs/my-website/release_notes/v1.72.2/index.md index 0f7da53b8b..f44dcf1bd1 100644 --- a/docs/my-website/release_notes/v1.72.2/index.md +++ b/docs/my-website/release_notes/v1.72.2/index.md @@ -53,9 +53,10 @@ pip install litellm==1.72.2 ## TLDR * **Why Upgrade** - - /v1/messages API performance improvements (lower latency, higher RPS) - - Multi instance rate limiting support - - Full Claude-4 cost tracking & Gemini 2.5 Pro preview + - Performance Improvements for /v1/messages: For this endpoint LiteLLM Proxy overhead is now down to 50ms at 250 RPS. + - Audit Logs on UI: Track when Keys, Teams, and Models were deleted by viewing Audit Logs on the LiteLLM UI. + - /v1/messages all models support: You can now use all LiteLLM models (`gpt-4.1`, `o1-pro`, `gemini-2.5-pro`) with /v1/messages API. + - Anthropic MCP: Use remote MCP Servers with Anthropic Models. * **Who Should Read** - Teams using `/v1/messages` API (Claude Code), LiteLLM Rate Limiting * **Risk of Upgrade** @@ -68,15 +69,26 @@ pip install litellm==1.72.2 ## `/v1/messages` Performance Improvements -This release brings significant performance improvements to the `/v1/messages` API. For large streaming requests LiteLLM overhead latency is now 50ms and can handle 250 RPS per instance. - +This release brings significant performance improvements to the /v1/messages API on LiteLLM. + +For this endpoint LiteLLM Proxy overhead latency is now down to 50ms, and each instance can handle 250 RPS. We validated these improvements through load testing with payloads containing over 1,000 streaming chunks. + +This is great for real time use cases with large requests (eg. multi turn conversations, Claude Code, etc.). + + + ## Audit Logs on UI + + This release introduces support for viewing audit logs in the UI. As a Proxy Admin, you can now check if and when a key was deleted, along with who performed the action. LiteLLM tracks changes to the following entities and actions: @@ -84,11 +96,6 @@ LiteLLM tracks changes to the following entities and actions: - **Entities:** Keys, Teams, Users, Models - **Actions:** Create, Update, Delete, Regenerate - - ## New Models / Updated Models