Commit Graph
20482 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 0de015b4c5 Revert "Fix latency redis" 2025-03-19 18:11:22 -07:00
Krish DholakiaandGitHub 57503954fe Merge pull request #9387 from emerzon/fix_latency_redis
Fix latency redis
2025-03-19 18:11:18 -07:00
Emerson Gomes c91aafeed8 Handle empty valid_deployments in LowestLatencyLoggingHandler 2025-03-19 19:56:57 -05:00
Krish DholakiaandGitHub 08e4614842 Merge pull request #9382 from BerriAI/litellm_dev_03_19_2025_p2
Support 'prisma migrate' for db schema changes
2025-03-19 16:37:47 -07:00
Krish DholakiaandGitHub 9432d1a865 Merge pull request #9357 from BerriAI/litellm_dev_03_18_2025_p2
fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis
2025-03-19 15:45:10 -07:00
Krrish Dholakia 61cd02200c fix: remove unused import 2025-03-19 15:33:04 -07:00
Krrish Dholakia 665fdfc788 feat(prisma_client.py): initial commit add prisma migration support to proxy 2025-03-19 14:26:59 -07:00
Krish DholakiaandGitHub 0d5abefe5f Merge pull request #9376 from BerriAI/litellm_fix_cred_check
Feature flag checking LiteLLM_CredentialsTable
2025-03-19 12:47:44 -07:00
Krrish Dholakia 8464f06df7 docs(config_settings.md): cleanup 2025-03-19 12:06:07 -07:00
Krrish Dholakia 041d5391eb test(test_proxy_server.py): make test work on ci/cd 2025-03-19 12:01:37 -07:00
Krrish Dholakia 79db96dd13 docs(config_settings.md): update env var information 2025-03-19 11:47:14 -07:00
Krrish Dholakia 858da57b3c test(test_proxy_server.py): add unit test to ensure get credentials only called behind feature flag 2025-03-19 11:44:00 -07:00
Krrish Dholakia c13f6514bf fix(proxy_server.py): move db credential check to only run behind feature flag 2025-03-19 11:35:14 -07:00
Ishaan JaffandGitHub 08c362e1b1 Merge pull request #9375 from colesmcintosh/fix-litellm-proxy-docs
docs(litellm_proxy): correct parameter assignment in litellm proxy docs
2025-03-19 11:14:19 -07:00
Cole McIntosh c5687ce94b docs(litellm_proxy): update parameter assignment for streaming call 2025-03-19 11:13:17 -06:00
Cole McIntosh e2caf21131 docs(litellm_proxy): correct parameter assignment in sample litellm proxy call docs 2025-03-19 11:08:34 -06:00
Krrish Dholakia edc38280ea docs(enterprise.md): clarify sla's 2025-03-19 09:09:02 -07:00
Krish DholakiaandGitHub 01c6cbd270 Merge pull request #9363 from BerriAI/litellm_dev_03_18_2025_p3
fix(common_utils.py): handle cris only model
2025-03-18 23:36:12 -07:00
Krrish Dholakia 9adad381b4 fix(common_utils.py): handle cris only model
Fixes https://github.com/BerriAI/litellm/issues/9161#issuecomment-2734905153
2025-03-18 23:35:43 -07:00
Ishaan JaffandGitHub e32aee9124 Merge pull request #9353 from BerriAI/litellm_arize_dynamic_logging
[Feat] - API - Allow using dynamic Arize AI Spaces on LiteLLM
2025-03-18 23:35:28 -07:00
Krish DholakiaandGitHub 6347b694ee Merge pull request #9335 from BerriAI/litellm_dev_03_17_2025_p3
Contributor PR: Fix sagemaker too little data for content error
2025-03-18 23:24:07 -07:00
Ishaan Jaff 8690873488 test_arize_dynamic_params 2025-03-18 23:22:55 -07:00
Ishaan Jaff 8568caf532 test_arize_dynamic_params 2025-03-18 23:18:07 -07:00
Krrish Dholakia 2c69b5d221 fix(base_routing_strategy.py): refactor for cleaner code 2025-03-18 22:57:05 -07:00
Krish DholakiaandGitHub c83e19e8c7 Merge pull request #9361 from BerriAI/litellm_fix_azure_gpt_4o_pricing
build(model_prices_and_context_window.json): fix azure gpt-4o pricing
2025-03-18 22:42:38 -07:00
Krrish Dholakia 084e8c425c refactor(base_routing_strategy.py): fix function names 2025-03-18 22:41:02 -07:00
Krrish Dholakia 0194c18820 build(model_prices_and_context_window.json): fix azure gpt-4o pricing
fix default to use latest global pricing
2025-03-18 22:34:58 -07:00
Ishaan Jaff f5ef0c3cb7 fix code quality checks 2025-03-18 22:34:43 -07:00
Krrish Dholakia 3033c40739 fix(base_routing_strategy.py): fix base to handle no running event loop
run in a separate thread
2025-03-18 22:20:39 -07:00
Ishaan Jaff 0f2e095b6b _arize_otel_logger 2025-03-18 22:19:51 -07:00
Ishaan Jaff 57e5c94360 Merge branch 'main' into litellm_arize_dynamic_logging 2025-03-18 22:13:35 -07:00
Ishaan JaffandGitHub c101fe9b5d Merge pull request #9352 from BerriAI/litellm_arize_mar_18
[Bug Fix] Arize AI Logging Integration with LiteLLM
2025-03-18 22:12:46 -07:00
Ishaan Jaff 412ad0d64e test_arize_callback 2025-03-18 20:21:23 -07:00
Krrish Dholakia a3d000baaa fix(test_base_routing_strategy.py): add unit testing for new base routing strategy test 2025-03-18 19:59:06 -07:00
Krrish Dholakia ef008138a3 feat(base_routing_strategy.py): handle updating in-memory keys 2025-03-18 19:44:04 -07:00
Krrish Dholakia 1328afe612 fix(lowest_tpm_rpm_v2.py): support batch writing increments to redis 2025-03-18 19:09:53 -07:00
Ishaan Jaff 19a7bfa6b5 test_arize_callback 2025-03-18 18:49:06 -07:00
Ishaan Jaff 00795f2bbf test arize logging 2025-03-18 18:40:39 -07:00
Krish DholakiaandGitHub 24fbadf072 Merge pull request #9355 from BerriAI/litellm_dev_03_18_2025_p1
Litellm dev 03 18 2025 p1
2025-03-18 18:34:06 -07:00
Krrish Dholakia a34cc2031d fix(response_metadata.py): log the litellm_model_name
make it easier to track the model sent to the provider
2025-03-18 17:46:33 -07:00
Krrish Dholakia 8ed3483adb test(test_tpm_rpm_routing_v2.py): initial test, for asserting async pre call check works as expected 2025-03-18 17:36:55 -07:00
Krrish Dholakia 453729b6c9 fix(litellm_logging.py): fix update 2025-03-18 17:18:58 -07:00
Krrish Dholakia 39ac9e3eca fix(lowest_tpm_rpm_v2.py): fix updating limits 2025-03-18 17:10:17 -07:00
Ishaan Jaff 78a5dde31f fix code qa 2025-03-18 17:07:44 -07:00
Ishaan Jaff bd122f631e fix arize config 2025-03-18 16:54:31 -07:00
Krrish Dholakia cfe94c86cc fix(lowest_tpm_rpm_routing_v2.py): fix deployment update to use correct keys 2025-03-18 16:28:37 -07:00
Krrish Dholakia 9bf6028f14 fix(lowest_tpm_rpm_v2.py): update key to use model name 2025-03-18 16:19:47 -07:00
Ishaan Jaff de97cda445 refactor create_litellm_proxy_request_started_spen 2025-03-18 16:12:16 -07:00
Ishaan Jaff f4b7b49e9a fix arize logging 2025-03-18 15:51:58 -07:00
Ishaan Jaff 7a5726fc88 fix - Arize - only log LLM I/O 2025-03-18 15:50:38 -07:00