Commit Graph
16858 Commits
Author SHA1 Message Date
Ishaan Jaff 8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff 225ff8432d test vertex ai text to speech 2024-08-23 16:06:39 -07:00
Ishaan Jaff 755a0514f6 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff 82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff 5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00
Ishaan Jaff c3987745fe fix linting errors 2024-08-23 15:44:31 -07:00
Ishaan Jaff 49b25db516 init comit for vtx text to speech 2024-08-23 15:40:52 -07:00
Ishaan Jaff 960a141884 add test_audio_speech_litellm_vertex 2024-08-23 15:36:42 -07:00
Ishaan JaffandGitHub 92e5cd113d Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails
[Feat-Proxy] Add Custom Guardrails
2024-08-23 12:11:31 -07:00
Ishaan Jaff 918e4fcfe5 feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff 5895f0c615 fix custom guardrail test 2024-08-23 11:58:20 -07:00
Ishaan Jaff 1b1e0f2d77 init custom guardrail class 2024-08-23 10:54:42 -07:00
Ishaan Jaff 7d30188f84 custom_callbacks 2024-08-23 09:52:52 -07:00
Ishaan Jaff d40695b979 docs custom guardrails 2024-08-23 09:50:19 -07:00
Ishaan Jaff d10430c881 doc custom guardrail 2024-08-23 09:41:54 -07:00
Ishaan Jaff a99258440c fix use guardrail for pre call hook 2024-08-23 09:34:08 -07:00
Krrish Dholakia 93ed8c7216 fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls
Fixes https://github.com/BerriAI/litellm/issues/5338

Also adds together ai json mode support
2024-08-23 09:21:32 -07:00
Ishaan Jaff af92cff44d add custom guardrail reference 2024-08-23 08:32:07 -07:00
Ishaan Jaff e62d0c7922 add the ability to init a custom guardrail 2024-08-23 08:21:07 -07:00
Krrish Dholakia 874d58fe8a fix(factory.py): support 'add_generation_prompt' field for hf chat templates
Fixes https://github.com/BerriAI/litellm/pull/5178#issuecomment-2306362008
2024-08-23 08:06:21 -07:00
Krrish Dholakia afb00a27cb fix(litellm_pre_call_utils.py): don't override k-v pair sent in spend_logs_metadata by user 2024-08-23 07:10:18 -07:00
Ishaan Jaff 4ac78a0765 fix prom latency metrics v1.44.4.dev2 2024-08-23 06:59:19 -07:00
Krrish Dholakia 52fb1e0c38 docs(caching.md): add redis cluster support to docs 2024-08-22 22:16:07 -07:00
Krrish Dholakia cee69a92ce docs(bedrock.md): add docs on alternating user/assistant messages 2024-08-22 22:10:10 -07:00
Ishaan Jaff 1765976ce0 use with base64 2024-08-22 20:49:39 -07:00
Ishaan Jaff ed2d3f4bf8 allow load testing sagemaker url 2024-08-22 20:03:27 -07:00
Krrish Dholakia 3f96a8c667 bump: version 1.44.3 → 1.44.4 v1.44.4 2024-08-22 19:31:35 -07:00
Krish DholakiaandGitHub 0a5fc42f5c Merge pull request #5337 from BerriAI/litellm_azure_batch_apis
feat(batches): add azure openai batches endpoint support
2024-08-22 19:08:00 -07:00
Krish DholakiaandGitHub 76b3db334b Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff b054dd0e45 docs fix 2024-08-22 19:04:14 -07:00
Ishaan Jaff 25609a94ad docs moderation 2024-08-22 18:57:54 -07:00
Krrish Dholakia 56cb94ac5e docs(batches.md): add more examples to docs 2024-08-22 18:51:44 -07:00
Ishaan Jaff b865993b34 docs move pass thru endpoints 2024-08-22 18:49:26 -07:00
Ishaan Jaff 18cd905a1f ci/cd run again v1.44.3 2024-08-22 18:41:10 -07:00
Ishaan Jaff 95beba870e bump: version 1.44.2 → 1.44.3 2024-08-22 18:27:38 -07:00
Krrish Dholakia 11c7e92b58 docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
Ishaan JaffandGitHub 645da5b437 Merge pull request #5332 from BerriAI/litellm_allow_using_azure_ad_token_auth
[Feat] Azure OpenAI add support for using azure_ad_token_provider with LiteLLM Proxy + Router
2024-08-22 18:21:54 -07:00
Ishaan JaffandGitHub 228252b92d Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Ishaan Jaff 2bf1fb3275 add test for test_azure_tenant_id_auth 2024-08-22 18:09:00 -07:00
Ishaan JaffandGitHub 2d57fab79f Merge pull request #5339 from BerriAI/litellm_add_bedrock_guardrails
[Feat-Proxy] add bedrock guardrails support
2024-08-22 17:28:57 -07:00
Ishaan JaffandGitHub 70f9e41ed9 Merge branch 'main' into litellm_add_bedrock_guardrails 2024-08-22 17:28:49 -07:00
Ishaan Jaff 1f0cc72531 test bedrock guardrails 2024-08-22 17:24:42 -07:00
Krrish Dholakia e445b78490 docs(configs.md): add global_max_parallel_requests to docs 2024-08-22 17:12:52 -07:00
Krrish Dholakia 735fc804ed fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit 2024-08-22 16:49:52 -07:00
Krrish Dholakia 7398e94472 fix(files_endpoints.py): fix multiple args error 2024-08-22 16:42:44 -07:00
Krrish Dholakia d7b525f391 feat(auth_checks.py): allow team to call all models, when explicitly set via /* 2024-08-22 16:38:56 -07:00
Ishaan Jaff 9e3d573bcb add async_post_call_success_hook 2024-08-22 16:34:43 -07:00
Ishaan Jaff 499b6b3368 doc bedrock guardrails 2024-08-22 16:25:22 -07:00
Ishaan Jaff f13a65be2d fix azure_ad_token_provider 2024-08-22 16:15:53 -07:00
Krish DholakiaandGitHub 3cf009efbf Merge pull request #5325 from BerriAI/litellm_redis_cluster
feat(caching.py): redis cluster support
2024-08-22 16:13:45 -07:00