tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-23 18:25:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs(prometheus.md): add litellm service metrics to prometheus docs

Browse Source
This commit is contained in:
Krrish Dholakia
2024-04-18 16:06:12 -07:00
parent 0f95a824c4
commit 48d3b563d8
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/proxy/prometheus.md
+2
View File
@@ -14,6 +14,7 @@ model_list:
model: gpt-3.5-turbo
litellm_settings:
success_callback: ["prometheus"]
failure_callback: ["prometheus"]
```
Start the proxy
@@ -70,3 +71,4 @@ litellm_settings:
|----------------------|--------------------------------------|
| `litellm_redis_latency` | histogram latency for redis calls |
| `litellm_redis_fails` | Number of failed redis calls |
| `litellm_self_latency` | Histogram latency for successful litellm api call |