090f847bd9
[Feat] QA - Arize Team based logging ( #12331 )
...
* add _get_tracer_with_dynamic_headers
* fix construct_dynamic_arize_headers
* [Feat] UI - Allow Viewing/Editing Team Based Callbacks (#12329 )
* add logging settings view on UI
* fix change ordering
* add construct_dynamic_otel_headers for arize
* refactor common code
* test_construct_dynamic_arize_headers
* otel unit tests
* test_arize_dynamic_params
* test_arize_dynamic_headers_in_grpc_requests
2025-07-04 18:17:09 -07:00
a03390ccc7
Litellm dev 07 03 2025 p2 ( #12301 )
...
* fix(langfuse_prompt_management.py): add langfuse prompt version param support
Adds prompt versioning support
* test(test_langfuse_prompt_management.py): add unit test
* fix: fix linting errors
* fix: add prompt_version instrumentation
* fix(langfuse_otel.py): correctly read env var
* docs(langfuse_integration.md): clarify v3 recommendation is to use langfuse_otel
Closes https://github.com/BerriAI/litellm/issues/11500
* docs(langfuse_otel_integration.md): cleanup docs
* test: fix test
* test: update tests
* fix: fix linting error
2025-07-03 22:40:21 -07:00
eef0623443
[Feat] Add Arize Team Based Logging ( #12264 )
...
* working KeyAndTeamLoggingSettings
* add arize_space_id to StandardCallbackDynamicParams
* add construct_dynamic_arize_headers
* add construct_dynamic_arize_headers to
* update otel arize logging
* fix imports
* test_construct_dynamic_arize_headers
* dynamic key/team settings
* test_get_dynamic_logging_metadata_with_arize_team_logging
2025-07-02 17:15:35 -07:00
66fafa3a7f
[Feat] Polish - add better error validation when users configure prometheus metrics and labels to control cardinality ( #12182 )
...
* self._pretty_print_invalid_metric_error
* docs prometheus.md
* test prom validation checks
* update metric name
* fix _pretty_print_validation_errors
* fix linting
* test prometheus
* test fixes - prometheus
2025-07-01 20:17:17 -07:00
a5c2475ecf
OpenMeter integration error handling fix ( #12147 )
...
* fix - tuple was never falsy so never triggered the exception
* test - add test suite for openmeter integration
* refactor - move tests for openmeter integration
2025-07-01 18:12:54 -07:00
308e82d885
LiteLLM SDK <-> Proxy improvement (don't transform message client-side) + Bedrock - handle qs:.. in base64 file data + Tag Management - support adding public model names ( #11908 )
...
* fix(factory.py): handle qs:.. in mime type
Fixes https://github.com/BerriAI/litellm/issues/11839
* feat(litellm_proxy/): don't transform messages client-side
leave litellm proxy messages untouched - allow proxy to handle transformation
prevents double transformation
* feat(tag_management_endpoints.py): support adding models to tag by adding model_name
Closes https://github.com/BerriAI/litellm/issues/11884
* test(test_tag_management_endpoints.py): add unit tests for adding new model by public model name
* test: update test
2025-06-19 22:34:18 -07:00
c92b6c175c
Prometheus - fix request increment + add route tracking for streaming requests ( #11731 )
...
* fix(prometheus.py): remove request increment from inside the log success event
it's only done on post-call success/failure
* fix(litellm_logging.py): add additional validation step for checking if 'stream' is true
prevent double counting on non-stream requests
* test: add unit testing to ensure stream is not incorrectly set to true
* feat(litellm_logging.py): emit request route in standard logging payload
used by prometheus streaming metrics for route
* fix: fix otel test
* fix: fix linting errors
* test: update test
* fix: fix linting error
2025-06-14 16:26:48 -07:00
b091c1ac4d
[Feat] Prometheus - Allow controlling exposed metrics and labels ( #11489 )
...
* feat: init prometheus_metrics_config
* feat: add prometheus_metrics_config
* test prometheus
* feat: use factor to init metrics
* fix - pretty print allowed metrics controls
* fix config
* fix - working get_labels_for_metric
* test_no_prometheus_config
* docs update prometheus
2025-06-14 13:56:40 -07:00
7df76175b4
fix(prometheus.py): fix total token increment + add semantic tests for prometheus metrics ( #11718 )
...
fixes regression where total requests was incremented by token value
2025-06-13 16:43:00 -07:00
f782cc7e4d
update GCSBucketBase to handle GSM project ID if passed ( #11409 )
2025-06-04 10:02:26 -07:00
a1f3a1c5dc
[Feat] Performance - Don't create 1 task for every hanging request alert ( #11385 )
...
* feat: add async_get_oldest_n_keys in memory cache
* fix: add add_request_to_hanging_request_check
* test: alerting
* feat: v2 hanging request check
* fix: HangingRequestData
* fix: AlertingHangingRequestCheck
* fix: check_for_hanging_requests
* fix: use correct metadata location for hanging requests
* fix: formatting alert
* test hanging request check
* fix: add guard flags for background tasks alerting
2025-06-03 21:12:54 -07:00
0590b1eb3a
[Fix] Prometheus Metrics - Do not track end_user by default + expose flag to enable tracking end_user on prometheus ( #11192 )
...
* fix: testing for disabling end user on metrics
* fix: fixes for test_prometheus_factory
* Delete litellm/model_prices_and_context_window_backup.json
* fix: issues with merge conflicts
* fix: test_get_end_user_id_for_cost_tracking_prometheus_only
* Update tests/test_litellm/integrations/test_prometheus.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-05-27 17:06:58 -07:00
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
Ishaan Jaff