From 52ae17746bf8107a4d9dff2e7c73d1eebcc4360b Mon Sep 17 00:00:00 2001 From: Krish Dholakia Date: Sat, 7 Mar 2026 19:27:41 -0800 Subject: [PATCH] docs: link dynamic TPM/RPM limiting to request prioritization doc (#22988) Co-authored-by: Cursor Agent --- docs/my-website/docs/proxy/dynamic_rate_limit.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/my-website/docs/proxy/dynamic_rate_limit.md b/docs/my-website/docs/proxy/dynamic_rate_limit.md index 3c3500f8a6..09a111f729 100644 --- a/docs/my-website/docs/proxy/dynamic_rate_limit.md +++ b/docs/my-website/docs/proxy/dynamic_rate_limit.md @@ -3,6 +3,8 @@ Prevent projects from gobbling too much tpm/rpm. +**See Also:** [Request Prioritization](../scheduler.md) - Prioritize LLM API requests in high-traffic by adding them to a priority queue. + Dynamically allocate TPM/RPM quota to api keys, based on active keys in that minute. [**See Code**](https://github.com/BerriAI/litellm/blob/9bffa9a48e610cc6886fc2dce5c1815aeae2ad46/litellm/proxy/hooks/dynamic_rate_limiter.py#L125) ## Quick Start Usage