From 48d3b563d86331a9f25f909f2214bb2902dc25ca Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Thu, 18 Apr 2024 16:06:12 -0700 Subject: [PATCH] docs(prometheus.md): add litellm service metrics to prometheus docs --- docs/my-website/docs/proxy/prometheus.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/docs/my-website/docs/proxy/prometheus.md b/docs/my-website/docs/proxy/prometheus.md index 7135639bfc..b1fb62ad51 100644 --- a/docs/my-website/docs/proxy/prometheus.md +++ b/docs/my-website/docs/proxy/prometheus.md @@ -14,6 +14,7 @@ model_list: model: gpt-3.5-turbo litellm_settings: success_callback: ["prometheus"] + failure_callback: ["prometheus"] ``` Start the proxy @@ -70,3 +71,4 @@ litellm_settings: |----------------------|--------------------------------------| | `litellm_redis_latency` | histogram latency for redis calls | | `litellm_redis_fails` | Number of failed redis calls | +| `litellm_self_latency` | Histogram latency for successful litellm api call |