From 419423cf434ff0d0c5bae62446cfccaedfff45f9 Mon Sep 17 00:00:00 2001 From: Alexsander Hamir Date: Sat, 17 Jan 2026 18:06:14 -0800 Subject: [PATCH] docs: add performance improvement section (#19300) --- docs/my-website/release_notes/v1.81.0/index.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/my-website/release_notes/v1.81.0/index.md b/docs/my-website/release_notes/v1.81.0/index.md index 51eac80a1a..6b3cf96253 100644 --- a/docs/my-website/release_notes/v1.81.0/index.md +++ b/docs/my-website/release_notes/v1.81.0/index.md @@ -47,6 +47,7 @@ pip install litellm==1.81.0 - **Claude Code** - Support for using web search across Bedrock, Vertex AI, and all LiteLLM providers - **Major Change** - [50MB limit on image URL downloads](#major-change---chatcompletions-image-url-download-size-limit) to improve reliability +- **Performance** - [25% CPU Usage Reduction](#performance---25-cpu-usage-reduction) by removing premature model.dump() calls from the hot path - **Deleted Keys Audit Table on UI** - [View deleted keys and teams for audit purposes](../../docs/proxy/deleted_keys_teams.md) with spend and budget information at the time of deletion --- @@ -155,6 +156,12 @@ This feature improves reliability by: --- +## Performance - 25% CPU Usage Reduction + +LiteLLM now reduces CPU usage by removing premature `model.dump()` calls from the hot path in request processing. Previously, Pydantic model serialization was performed earlier and more frequently than necessary, causing unnecessary CPU overhead on every request. By deferring serialization until it is actually needed, LiteLLM reduces CPU usage and improves request throughput under high load. + +--- + ## Deleted Keys Audit Table on UI