66fafa3a7f
[Feat] Polish - add better error validation when users configure prometheus metrics and labels to control cardinality ( #12182 )
...
* self._pretty_print_invalid_metric_error
* docs prometheus.md
* test prom validation checks
* update metric name
* fix _pretty_print_validation_errors
* fix linting
* test prometheus
* test fixes - prometheus
2025-07-01 20:17:17 -07:00
c92b6c175c
Prometheus - fix request increment + add route tracking for streaming requests ( #11731 )
...
* fix(prometheus.py): remove request increment from inside the log success event
it's only done on post-call success/failure
* fix(litellm_logging.py): add additional validation step for checking if 'stream' is true
prevent double counting on non-stream requests
* test: add unit testing to ensure stream is not incorrectly set to true
* feat(litellm_logging.py): emit request route in standard logging payload
used by prometheus streaming metrics for route
* fix: fix otel test
* fix: fix linting errors
* test: update test
* fix: fix linting error
2025-06-14 16:26:48 -07:00
b091c1ac4d
[Feat] Prometheus - Allow controlling exposed metrics and labels ( #11489 )
...
* feat: init prometheus_metrics_config
* feat: add prometheus_metrics_config
* test prometheus
* feat: use factor to init metrics
* fix - pretty print allowed metrics controls
* fix config
* fix - working get_labels_for_metric
* test_no_prometheus_config
* docs update prometheus
2025-06-14 13:56:40 -07:00
7df76175b4
fix(prometheus.py): fix total token increment + add semantic tests for prometheus metrics ( #11718 )
...
fixes regression where total requests was incremented by token value
2025-06-13 16:43:00 -07:00
0590b1eb3a
[Fix] Prometheus Metrics - Do not track end_user by default + expose flag to enable tracking end_user on prometheus ( #11192 )
...
* fix: testing for disabling end user on metrics
* fix: fixes for test_prometheus_factory
* Delete litellm/model_prices_and_context_window_backup.json
* fix: issues with merge conflicts
* fix: test_get_end_user_id_for_cost_tracking_prometheus_only
* Update tests/test_litellm/integrations/test_prometheus.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-05-27 17:06:58 -07:00
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
Ishaan Jaff