Commit Graph
17165 Commits
Author SHA1 Message Date
Kyrylo Yefimenko a100b01b90 Add pricing for Openai ft:gpt-4o 2024-08-30 08:16:24 +01:00
Krrish Dholakia 856ed40a07 bump: version 1.44.11 → 1.44.12 2024-08-29 22:41:10 -07:00
Krish DholakiaandGitHub dd7b008161 fix: Minor LiteLLM Fixes + Improvements (29/08/2024) (#5436)
* fix(model_checks.py): support returning wildcard models on `/v1/models`

Fixes https://github.com/BerriAI/litellm/issues/4903

* fix(bedrock_httpx.py): support calling bedrock via api_base

Closes https://github.com/BerriAI/litellm/pull/4587

* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked

Fixes https://github.com/BerriAI/litellm/issues/5433

* feat(router.py): support setting 'weight' param for models on router

Closes https://github.com/BerriAI/litellm/issues/5410

* test(test_bedrock_completion.py): add unit test for custom api base

* fix(model_checks.py): handle no "/" in model
2024-08-29 22:40:25 -07:00
Ishaan Jaff f70b7575d2 update docs 2024-08-29 21:00:10 -07:00
Ishaan Jaff 26c03c9c8b add pricing for vertex ai 21 2024-08-29 19:03:38 -07:00
Ishaan Jaff ef47b2bc87 mark test_cost_tracking_with_caching as flaky v1.44.11 v1.44.11-stable 2024-08-29 17:44:21 -07:00
Ishaan Jaff d57f5a955e bump: version 1.44.10 → 1.44.11 2024-08-29 17:37:01 -07:00
Ishaan JaffandGitHub 9444b34711 Merge pull request #5432 from BerriAI/litellm_add_tag_control_team
[Feat-Proxy] Set tags per team - (use tag based routing for team)
2024-08-29 17:34:58 -07:00
Ishaan JaffandGitHub e329c4509a Merge branch 'main' into litellm_add_tag_control_team 2024-08-29 17:34:40 -07:00
Ishaan JaffandGitHub ef16738720 Merge pull request #5435 from BerriAI/litellm_fwd_vtx_sdk_headers
[Feat-Proxy] Pass through Vertex Endpoint - allow forwarding vertex credentials
2024-08-29 17:24:35 -07:00
Ishaan JaffandGitHub 010f526226 Merge branch 'main' into litellm_fwd_vtx_sdk_headers 2024-08-29 17:24:31 -07:00
Ishaan Jaff a4b88c16dc fix indentation 2024-08-29 17:01:23 -07:00
Ishaan Jaff 748cc80783 fix auth checks for provider routes 2024-08-29 16:40:46 -07:00
Ishaan Jaff e449bf062d add docs on pass thtough 2024-08-29 16:12:14 -07:00
Ishaan Jaff 41a5daf20c add test for vertex sdk foward headers 2024-08-29 15:50:54 -07:00
Ishaan Jaff 9fb188a3b6 vertex add vertex endpoints 2024-08-29 15:49:25 -07:00
Krrish Dholakia 601945d114 docs(docker_quick_start.md): add new quick start doc for litellm proxy 2024-08-29 15:35:39 -07:00
Ishaan Jaff 4b7ceade64 mark test_key_info_spend_values_streaming as flaky 2024-08-29 14:39:53 -07:00
Ishaan Jaff da2cefc45a fix team based tag routing 2024-08-29 14:37:44 -07:00
Ishaan JaffandGitHub 208fe6cb90 Merge pull request #5430 from Manouchehri/bedrock-cross-inference-1
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 14:30:11 -07:00
Ishaan JaffandGitHub 5851a8f901 Merge pull request #5431 from BerriAI/litellm_Add_fireworks_ai_health_check
[Fix-Proxy] /health check for provider wildcard models (fireworks/*)
2024-08-29 14:25:05 -07:00
Ishaan Jaff 308377fbe2 docs tag based routing per team 2024-08-29 14:23:55 -07:00
Ishaan Jaff 242f66054d enable_tag_filtering 2024-08-29 14:14:46 -07:00
Ishaan Jaff d9433d9f94 doc Tag Based Routing 2024-08-29 14:14:37 -07:00
Ishaan Jaff 944c7ac3fa fix missing link on docs 2024-08-29 14:00:16 -07:00
Ishaan Jaff f592aeaa38 add test_chat_completion_with_no_tags 2024-08-29 13:54:11 -07:00
Ishaan Jaff 84bda9cc80 fix get_deployments_for_tag 2024-08-29 13:51:36 -07:00
Ishaan Jaff 34f1d32799 add test for tag based routing 2024-08-29 13:45:24 -07:00
Ishaan Jaff 2cb4882e70 define tags on model list 2024-08-29 13:06:39 -07:00
Ishaan Jaff ff42962750 add_team_based_tags_to_metadata 2024-08-29 13:06:03 -07:00
Ishaan Jaff ffeb5ce22a add set / update tags for a team 2024-08-29 13:05:00 -07:00
Ishaan Jaff 5e590e7326 allow settings tags per team 2024-08-29 13:03:49 -07:00
Ishaan Jaff d2ddc5aba9 add test_team_tags to set / update tags 2024-08-29 13:02:57 -07:00
Ishaan Jaff 284b8b3418 add test for health check 2024-08-29 11:16:20 -07:00
David Manouchehri 19db80ffeb (bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Ishaan Jaff b576233e66 add support for fireworks ai health check 2024-08-29 09:29:16 -07:00
Ishaan Jaff 45774010f7 add util to pick_cheapest_model_from_llm_provider 2024-08-29 09:27:20 -07:00
Ishaan Jaff 4b6a2fa4f3 add fireworks_ai_models 2024-08-29 09:23:11 -07:00
Krish DholakiaandGitHub 559a6ad826 fix(google_ai_studio): working context caching (#5421)
* fix(google_ai_studio): working context caching

* feat(vertex_ai_context_caching.py): support async cache check calls

* fix(vertex_and_google_ai_studio_gemini.py): fix setting headers

* fix(vertex_ai_parter_models): fix import

* fix(vertex_and_google_ai_studio_gemini.py): fix input

* test(test_amazing_vertex_completion.py): fix test
2024-08-29 07:00:30 -07:00
Krish DholakiaandGitHub 8ce1e49fbe fix(utils.py): correctly log streaming cache hits (#5417) (#5426)
Fixes https://github.com/BerriAI/litellm/issues/5401
2024-08-28 22:50:33 -07:00
Krrish Dholakia e9957f1265 bump: version 1.44.9 → 1.44.10 v1.44.10 v1.44.10-stable 2024-08-28 22:21:38 -07:00
Krish DholakiaandGitHub 8ae0fc693f Merge pull request #5414 from BerriAI/litellm_main_staging
fixes: minor litellm fixes
2024-08-28 22:01:01 -07:00
Krish DholakiaandGitHub 5b5538b039 Merge pull request #5425 from BerriAI/litellm_team_member_info_additional_fix
fix(team_endpoints.py): update to include the budget in the response
2024-08-28 22:00:32 -07:00
Krrish Dholakia 2119030738 fix(team_endpoints.py): update to include the budget in the response 2024-08-28 21:58:41 -07:00
Krish DholakiaandGitHub 68112e6dec Merge pull request #5423 from BerriAI/litellm_team_member_info
feat(team_endpoints.py): return team member budgets in /team/info call
2024-08-28 21:52:46 -07:00
Krrish Dholakia fd1cca207f test(test_amazing_vertex_completion.py): fix test 2024-08-28 21:12:39 -07:00
Krrish Dholakia 18689c25e9 feat(team_endpoints.py): return team member budgets in /team/info call
Fixes https://github.com/BerriAI/litellm/issues/5390
2024-08-28 19:14:01 -07:00
Krrish Dholakia dd9c5d10bd fix(vertex_ai_partner_models.py): fix vertex import 2024-08-28 18:08:33 -07:00
Krish DholakiaandGitHub a857f4a8ee Merge branch 'main' into litellm_main_staging 2024-08-28 18:05:27 -07:00
Krrish Dholakia f0fb8bdf45 fix(router.py): fix cooldown check v1.44.9 v1.44.8-dev1 2024-08-28 16:38:42 -07:00