Commit Graph
16874 Commits
Author SHA1 Message Date
Krrish Dholakia 74a85fac0e docs(aws_sagemaker.md): cleanup sagemaker messages api docs 2024-08-23 21:17:16 -07:00
Krish DholakiaandGitHub cd61ddc610 Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
feat(sagemaker.py): add sagemaker messages api support
2024-08-23 21:00:00 -07:00
Krrish Dholakia 30ec166556 test(test_sagemaker.py): fix test 2024-08-23 20:49:01 -07:00
Krish DholakiaandGitHub f458f565af Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
2024-08-23 20:42:35 -07:00
Krrish Dholakia ac9a1e65ab fix(proxy_server.py): fix post /v1/batches endpoint
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
2024-08-23 20:38:00 -07:00
Ishaan Jaff 2c60d98e34 bump: version 1.44.4 → 1.44.5 2024-08-23 18:30:34 -07:00
Ishaan JaffandGitHub 2116046b91 Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech
[Feat-LiteLLM] Add Vertex AI - Text to speech support
2024-08-23 18:29:53 -07:00
Ishaan Jaff a7bcc0e88e docs tts 2024-08-23 18:29:36 -07:00
Ishaan Jaff 80e95b4ccf add mock testing for vertex tts 2024-08-23 18:18:37 -07:00
Ishaan Jaff 8fada93fff docs on using vertex tts 2024-08-23 17:57:49 -07:00
Ishaan Jaff 225ff8432d test vertex ai text to speech 2024-08-23 16:06:39 -07:00
Krrish Dholakia ab28e55b76 fix(proxy_server.py): support env vars for controlling global max parallel request retry/timeouts
fixes issue where litellm module level settings weren't working for global retries, due to time of init
2024-08-23 16:06:08 -07:00
Ishaan Jaff 755a0514f6 fix linting 2024-08-23 16:05:31 -07:00
Ishaan Jaff 82c3357454 add example using tts on vertex ai 2024-08-23 16:04:51 -07:00
Ishaan Jaff 5c3a1484c3 docs text to speech 2024-08-23 15:50:03 -07:00
Ishaan Jaff c3987745fe fix linting errors 2024-08-23 15:44:31 -07:00
Ishaan Jaff 49b25db516 init comit for vtx text to speech 2024-08-23 15:40:52 -07:00
Ishaan Jaff 960a141884 add test_audio_speech_litellm_vertex 2024-08-23 15:36:42 -07:00
Krrish Dholakia 3007f0344d fix(utils.py): only filter additional properties if gemini/vertex ai 2024-08-23 14:22:59 -07:00
Ishaan JaffandGitHub 92e5cd113d Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails
[Feat-Proxy] Add Custom Guardrails
2024-08-23 12:11:31 -07:00
Ishaan Jaff 918e4fcfe5 feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff 5895f0c615 fix custom guardrail test 2024-08-23 11:58:20 -07:00
Ishaan Jaff 1b1e0f2d77 init custom guardrail class 2024-08-23 10:54:42 -07:00
Krrish Dholakia 3f116b25a9 feat(sagemaker.py): add sagemaker messages api support
Closes https://github.com/BerriAI/litellm/issues/2641

 Closes https://github.com/BerriAI/litellm/pull/5178
2024-08-23 10:31:35 -07:00
Ishaan Jaff 7d30188f84 custom_callbacks 2024-08-23 09:52:52 -07:00
Ishaan Jaff d40695b979 docs custom guardrails 2024-08-23 09:50:19 -07:00
Ishaan Jaff d10430c881 doc custom guardrail 2024-08-23 09:41:54 -07:00
Ishaan Jaff a99258440c fix use guardrail for pre call hook 2024-08-23 09:34:08 -07:00
Krrish Dholakia 93ed8c7216 fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls
Fixes https://github.com/BerriAI/litellm/issues/5338

Also adds together ai json mode support
2024-08-23 09:21:32 -07:00
Ishaan Jaff af92cff44d add custom guardrail reference 2024-08-23 08:32:07 -07:00
Ishaan Jaff e62d0c7922 add the ability to init a custom guardrail 2024-08-23 08:21:07 -07:00
Krrish Dholakia 874d58fe8a fix(factory.py): support 'add_generation_prompt' field for hf chat templates
Fixes https://github.com/BerriAI/litellm/pull/5178#issuecomment-2306362008
2024-08-23 08:06:21 -07:00
Krrish Dholakia afb00a27cb fix(litellm_pre_call_utils.py): don't override k-v pair sent in spend_logs_metadata by user 2024-08-23 07:10:18 -07:00
Ishaan Jaff 4ac78a0765 fix prom latency metrics v1.44.4.dev2 2024-08-23 06:59:19 -07:00
Krrish Dholakia 52fb1e0c38 docs(caching.md): add redis cluster support to docs 2024-08-22 22:16:07 -07:00
Krrish Dholakia cee69a92ce docs(bedrock.md): add docs on alternating user/assistant messages 2024-08-22 22:10:10 -07:00
Ishaan Jaff 1765976ce0 use with base64 2024-08-22 20:49:39 -07:00
Ishaan Jaff ed2d3f4bf8 allow load testing sagemaker url 2024-08-22 20:03:27 -07:00
Krrish Dholakia 3f96a8c667 bump: version 1.44.3 → 1.44.4 v1.44.4 2024-08-22 19:31:35 -07:00
Krish DholakiaandGitHub 0a5fc42f5c Merge pull request #5337 from BerriAI/litellm_azure_batch_apis
feat(batches): add azure openai batches endpoint support
2024-08-22 19:08:00 -07:00
Krish DholakiaandGitHub 76b3db334b Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff b054dd0e45 docs fix 2024-08-22 19:04:14 -07:00
Ishaan Jaff 25609a94ad docs moderation 2024-08-22 18:57:54 -07:00
Krrish Dholakia 56cb94ac5e docs(batches.md): add more examples to docs 2024-08-22 18:51:44 -07:00
Ishaan Jaff b865993b34 docs move pass thru endpoints 2024-08-22 18:49:26 -07:00
Ishaan Jaff 18cd905a1f ci/cd run again v1.44.3 2024-08-22 18:41:10 -07:00
Ishaan Jaff 95beba870e bump: version 1.44.2 → 1.44.3 2024-08-22 18:27:38 -07:00
Krrish Dholakia 11c7e92b58 docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
Ishaan JaffandGitHub 645da5b437 Merge pull request #5332 from BerriAI/litellm_allow_using_azure_ad_token_auth
[Feat] Azure OpenAI add support for using azure_ad_token_provider with LiteLLM Proxy + Router
2024-08-22 18:21:54 -07:00
Ishaan JaffandGitHub 228252b92d Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00