Commit Graph
16912 Commits
Author SHA1 Message Date
Krrish Dholakia 4e9f66bc7e fix(vertex_httpx.py): return project id, if given v1.44.6 v1.44.6-stable 1.44.6 2024-08-26 09:14:04 -07:00
Ishaan Jaff 98c1fb0fbd docs - explain how custom guardrail is mounted 2024-08-26 08:47:01 -07:00
Ishaan Jaff 735eb041b9 ci/cd run again 2024-08-26 08:36:58 -07:00
Krrish Dholakia 4d29c1fb69 fix(vertex_httpx.py): use dynamic project id 2024-08-24 23:34:20 -07:00
Krish DholakiaandGitHub 87dbdced06 Merge pull request #4582 from BerriAI/litellm_vertex_migration
refactor(main.py): migrate vertex gemini calls to vertex_httpx
2024-08-24 19:33:21 -07:00
Krrish Dholakia 64952ab044 fix: fix tests 2024-08-24 19:32:22 -07:00
Krish DholakiaandGitHub f27abe0462 Merge branch 'main' into litellm_vertex_migration 2024-08-24 18:24:19 -07:00
Krrish Dholakia 5019e0322f fix(utils.py): fix linting errors 2024-08-24 17:51:59 -07:00
Ishaan Jaff b2388e3409 test test_cooldown_same_model_name 2024-08-24 17:16:25 -07:00
Ishaan Jaff 366b78f2a5 bump: version 1.44.5 → 1.44.6 2024-08-24 16:46:55 -07:00
Ishaan Jaff d9769c393e ui new build 2024-08-24 16:45:53 -07:00
Ishaan Jaff 20840eaad3 fix linting errors when adding a new team member 2024-08-24 16:38:43 -07:00
Ishaan JaffandGitHub 0ad5f58930 Merge pull request #5357 from BerriAI/ui_allow_setting_tpm_rpm_per_model
[Feat] Admin UI - allow setting tpm / rpm per model
2024-08-24 16:28:08 -07:00
Ishaan JaffandGitHub c99914d18e Merge pull request #5356 from BerriAI/ui_allow_setting_rpm_tpm_on_ui
Feat - ui allow setting tpm / rpm limits on keys on ui
2024-08-24 16:27:58 -07:00
Ishaan JaffandGitHub 11187920ec Merge pull request #5352 from BerriAI/litellm_allow_setting_caching_mode
[Feat-Caching] allow setting caching mode to default off
2024-08-24 16:27:45 -07:00
Ishaan JaffandGitHub 35740da03d Merge pull request #5354 from BerriAI/vertex_allow_auth
[Feat-Vertex] Support using  workload identity federation
2024-08-24 16:27:29 -07:00
Ishaan Jaff e8b9fbf9f9 fix allow setting per model tpm rpm limits 2024-08-24 15:34:25 -07:00
Ishaan Jaff 98d1113e89 ui allow setting tpm / rpm limits on ui 2024-08-24 12:42:39 -07:00
Ishaan JaffandGitHub 16b1302702 Merge pull request #5350 from BerriAI/ui_show_user_id_on_table
Admin UI - show user_id on Key Table
2024-08-24 10:52:47 -07:00
Ishaan JaffandGitHub f597fab798 Merge pull request #5349 from BerriAI/dependabot/npm_and_yarn/ui/micromatch-4.0.8
build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui
2024-08-24 10:52:38 -07:00
Ishaan JaffandGitHub eb620a8b6b Merge pull request #5353 from BerriAI/litellm_fix_pip_nacl_error
[Fix] pip litellm proxy - No module named 'nacl'
2024-08-24 10:52:20 -07:00
Ishaan Jaff 3228125215 feat use identity_pool for vertex 2024-08-24 10:51:46 -07:00
Krrish Dholakia 5a2c9d5121 test(test_router.py): add test to ensure error is correctly re-raised 2024-08-24 10:08:14 -07:00
Krrish Dholakia 0b06a76cf9 fix(router.py): don't cooldown on apiconnectionerrors
Fixes issue where model would be in cooldown due to api connection errors
2024-08-24 09:53:05 -07:00
Ishaan Jaff ac6f15ae2c fix pynacl error 2024-08-24 09:48:45 -07:00
Ishaan Jaff 74f0e60962 fix set Caching Default Off 2024-08-24 09:43:39 -07:00
Ishaan Jaff feb354d3bc fix should_use_cache 2024-08-24 09:37:41 -07:00
Krrish Dholakia 8782ee444d feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265

Helps user see the stored budget per team member
2024-08-24 09:22:16 -07:00
Ishaan Jaff 01adc45f0f test caching default on /off 2024-08-24 09:06:59 -07:00
Ishaan Jaff 3c1da2e823 feat - allow setting cache mode 2024-08-24 09:03:59 -07:00
Krrish Dholakia 8c5ff150f6 fix(huggingface_restapi.py): fix tests v1.44.5 2024-08-23 21:40:27 -07:00
Krrish Dholakia 0c26b36d9d docs(input.md): update docs on together ai response_format params support 2024-08-23 21:34:18 -07:00
Krrish Dholakia 6d2ae5a0d8 fix(utils.py): support passing response_format for together ai calls 2024-08-23 21:31:59 -07:00
Krrish Dholakia 74a85fac0e docs(aws_sagemaker.md): cleanup sagemaker messages api docs 2024-08-23 21:17:16 -07:00
Krish DholakiaandGitHub cd61ddc610 Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
feat(sagemaker.py): add sagemaker messages api support
2024-08-23 21:00:00 -07:00
Ishaan Jaff f618eb0a67 fix show user_id on table 2024-08-23 20:54:44 -07:00
Krrish Dholakia 30ec166556 test(test_sagemaker.py): fix test 2024-08-23 20:49:01 -07:00
Krish DholakiaandGitHub f458f565af Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
2024-08-23 20:42:35 -07:00
Krrish Dholakia ac9a1e65ab fix(proxy_server.py): fix post /v1/batches endpoint
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
2024-08-23 20:38:00 -07:00
dependabot[bot]andGitHub 7f8a8279ea build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui
Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8.
- [Release notes](https://github.com/micromatch/micromatch/releases)
- [Changelog](https://github.com/micromatch/micromatch/blob/4.0.8/CHANGELOG.md)
- [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8)

---
updated-dependencies:
- dependency-name: micromatch
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-24 01:31:29 +00:00
Ishaan Jaff 2c60d98e34 bump: version 1.44.4 → 1.44.5 2024-08-23 18:30:34 -07:00
Ishaan JaffandGitHub 2116046b91 Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech
[Feat-LiteLLM] Add Vertex AI - Text to speech support
2024-08-23 18:29:53 -07:00
Ishaan Jaff a7bcc0e88e docs tts 2024-08-23 18:29:36 -07:00
Ishaan Jaff 80e95b4ccf add mock testing for vertex tts 2024-08-23 18:18:37 -07:00
Ishaan Jaff 8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff 225ff8432d test vertex ai text to speech 2024-08-23 16:06:39 -07:00
Krrish Dholakia ab28e55b76 fix(proxy_server.py): support env vars for controlling global max parallel request retry/timeouts
fixes issue where litellm module level settings weren't working for global retries, due to time of init
2024-08-23 16:06:08 -07:00
Ishaan Jaff 755a0514f6 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff 82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff 5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00