 Krrish Dholakia
|
cd7dd2a511
|
fix(cooldown_cache.py): fix linting errors
|
2024-08-27 07:40:28 -07:00 |
|
|
Krrish Dholakia
|
5572ad7241
|
fix(cooldown_cache.py): fix linting errors
|
2024-08-24 17:11:32 -07:00 |
|
|
Krrish Dholakia
|
33972cc79c
|
fix(router.py): enable dynamic retry after in exception string
Updates cooldown logic to cooldown individual models
Closes https://github.com/BerriAI/litellm/issues/1339
|
2024-08-24 16:59:30 -07:00 |
|
|
Krrish Dholakia
|
76834c6c59
|
test(test_router.py): add test to ensure retry-after matches received value
|
2024-08-24 15:21:04 -07:00 |
|
|
Krrish Dholakia
|
7beb0910c6
|
test(test_router.py): skip test - create separate pr to match retry after
|
2024-08-24 15:19:27 -07:00 |
|
|
Krrish Dholakia
|
756a828c15
|
fix(azure.py): add response header coverage for azure models
|
2024-08-24 15:12:51 -07:00 |
|
|
Krrish Dholakia
|
87549a2391
|
fix(main.py): cover openai /v1/completions endpoint
|
2024-08-24 13:25:17 -07:00 |
|
|
Krrish Dholakia
|
de2373d52b
|
fix(openai.py): coverage for correctly re-raising exception headers on openai chat completion + embedding endpoints
|
2024-08-24 12:55:15 -07:00 |
|
|
Krrish Dholakia
|
068aafdff9
|
fix(utils.py): correctly re-raise the headers from an exception, if present
Fixes issue where retry after on router was not using azure / openai numbers
|
2024-08-24 12:30:30 -07:00 |
|
|
Krrish Dholakia
|
5a2c9d5121
|
test(test_router.py): add test to ensure error is correctly re-raised
|
2024-08-24 10:08:14 -07:00 |
|
|
Krrish Dholakia
|
0b06a76cf9
|
fix(router.py): don't cooldown on apiconnectionerrors
Fixes issue where model would be in cooldown due to api connection errors
|
2024-08-24 09:53:05 -07:00 |
|
|
Krrish Dholakia
|
8782ee444d
|
feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265
Helps user see the stored budget per team member
|
2024-08-24 09:22:16 -07:00 |
|
|
Krrish Dholakia
|
8c5ff150f6
|
fix(huggingface_restapi.py): fix tests
v1.44.5
|
2024-08-23 21:40:27 -07:00 |
|
|
Krrish Dholakia
|
0c26b36d9d
|
docs(input.md): update docs on together ai response_format params support
|
2024-08-23 21:34:18 -07:00 |
|
|
Krrish Dholakia
|
6d2ae5a0d8
|
fix(utils.py): support passing response_format for together ai calls
|
2024-08-23 21:31:59 -07:00 |
|
|
Krrish Dholakia
|
74a85fac0e
|
docs(aws_sagemaker.md): cleanup sagemaker messages api docs
|
2024-08-23 21:17:16 -07:00 |
|
|
Krish Dholakia
|
cd61ddc610
|
Merge pull request #5343 from BerriAI/litellm_sagemaker_chat
feat(sagemaker.py): add sagemaker messages api support
|
2024-08-23 21:00:00 -07:00 |
|
|
Krrish Dholakia
|
30ec166556
|
test(test_sagemaker.py): fix test
|
2024-08-23 20:49:01 -07:00 |
|
|
Krish Dholakia
|
f458f565af
|
Merge pull request #5292 from OgnjenFrancuski/main
Update SSL verification
|
2024-08-23 20:42:35 -07:00 |
|
|
Krrish Dholakia
|
ac9a1e65ab
|
fix(proxy_server.py): fix post /v1/batches endpoint
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
|
2024-08-23 20:38:00 -07:00 |
|
|
Ishaan Jaff
|
2c60d98e34
|
bump: version 1.44.4 → 1.44.5
|
2024-08-23 18:30:34 -07:00 |
|
|
Ishaan Jaff
|
2116046b91
|
Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech
[Feat-LiteLLM] Add Vertex AI - Text to speech support
|
2024-08-23 18:29:53 -07:00 |
|
|
Ishaan Jaff
|
a7bcc0e88e
|
docs tts
|
2024-08-23 18:29:36 -07:00 |
|
|
Ishaan Jaff
|
80e95b4ccf
|
add mock testing for vertex tts
|
2024-08-23 18:18:37 -07:00 |
|
|
Ishaan Jaff
|
8fada93fff
|
docs on using vertex tts
|
2024-08-23 17:57:49 -07:00 |
|
|
Ishaan Jaff
|
225ff8432d
|
test vertex ai text to speech
|
2024-08-23 16:06:39 -07:00 |
|
|
Krrish Dholakia
|
ab28e55b76
|
fix(proxy_server.py): support env vars for controlling global max parallel request retry/timeouts
fixes issue where litellm module level settings weren't working for global retries, due to time of init
|
2024-08-23 16:06:08 -07:00 |
|
|
Ishaan Jaff
|
755a0514f6
|
fix linting
|
2024-08-23 16:05:31 -07:00 |
|
|
Ishaan Jaff
|
82c3357454
|
add example using tts on vertex ai
|
2024-08-23 16:04:51 -07:00 |
|
|
Ishaan Jaff
|
5c3a1484c3
|
docs text to speech
|
2024-08-23 15:50:03 -07:00 |
|
|
Ishaan Jaff
|
c3987745fe
|
fix linting errors
|
2024-08-23 15:44:31 -07:00 |
|
|
Ishaan Jaff
|
49b25db516
|
init comit for vtx text to speech
|
2024-08-23 15:40:52 -07:00 |
|
|
Ishaan Jaff
|
960a141884
|
add test_audio_speech_litellm_vertex
|
2024-08-23 15:36:42 -07:00 |
|
|
Krrish Dholakia
|
3007f0344d
|
fix(utils.py): only filter additional properties if gemini/vertex ai
|
2024-08-23 14:22:59 -07:00 |
|
|
Ishaan Jaff
|
92e5cd113d
|
Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails
[Feat-Proxy] Add Custom Guardrails
|
2024-08-23 12:11:31 -07:00 |
|
|
Ishaan Jaff
|
918e4fcfe5
|
feat add test for custom guardrails
|
2024-08-23 12:01:43 -07:00 |
|
|
Ishaan Jaff
|
5895f0c615
|
fix custom guardrail test
|
2024-08-23 11:58:20 -07:00 |
|
|
Ishaan Jaff
|
1b1e0f2d77
|
init custom guardrail class
|
2024-08-23 10:54:42 -07:00 |
|
|
Krrish Dholakia
|
3f116b25a9
|
feat(sagemaker.py): add sagemaker messages api support
Closes https://github.com/BerriAI/litellm/issues/2641
Closes https://github.com/BerriAI/litellm/pull/5178
|
2024-08-23 10:31:35 -07:00 |
|
|
Ishaan Jaff
|
7d30188f84
|
custom_callbacks
|
2024-08-23 09:52:52 -07:00 |
|
|
Ishaan Jaff
|
d40695b979
|
docs custom guardrails
|
2024-08-23 09:50:19 -07:00 |
|
|
Ishaan Jaff
|
d10430c881
|
doc custom guardrail
|
2024-08-23 09:41:54 -07:00 |
|
|
Ishaan Jaff
|
a99258440c
|
fix use guardrail for pre call hook
|
2024-08-23 09:34:08 -07:00 |
|
|
Krrish Dholakia
|
93ed8c7216
|
fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls
Fixes https://github.com/BerriAI/litellm/issues/5338
Also adds together ai json mode support
|
2024-08-23 09:21:32 -07:00 |
|
|
Ishaan Jaff
|
af92cff44d
|
add custom guardrail reference
|
2024-08-23 08:32:07 -07:00 |
|
|
Ishaan Jaff
|
e62d0c7922
|
add the ability to init a custom guardrail
|
2024-08-23 08:21:07 -07:00 |
|
|
Krrish Dholakia
|
874d58fe8a
|
fix(factory.py): support 'add_generation_prompt' field for hf chat templates
Fixes https://github.com/BerriAI/litellm/pull/5178#issuecomment-2306362008
|
2024-08-23 08:06:21 -07:00 |
|
|
Krrish Dholakia
|
afb00a27cb
|
fix(litellm_pre_call_utils.py): don't override k-v pair sent in spend_logs_metadata by user
|
2024-08-23 07:10:18 -07:00 |
|
|
Ishaan Jaff
|
4ac78a0765
|
fix prom latency metrics
v1.44.4.dev2
|
2024-08-23 06:59:19 -07:00 |
|
|
Krrish Dholakia
|
52fb1e0c38
|
docs(caching.md): add redis cluster support to docs
|
2024-08-22 22:16:07 -07:00 |
|