 Ishaan Jaff
|
4ac78a0765
|
fix prom latency metrics
v1.44.4.dev2
|
2024-08-23 06:59:19 -07:00 |
|
|
Krrish Dholakia
|
52fb1e0c38
|
docs(caching.md): add redis cluster support to docs
|
2024-08-22 22:16:07 -07:00 |
|
|
Krrish Dholakia
|
cee69a92ce
|
docs(bedrock.md): add docs on alternating user/assistant messages
|
2024-08-22 22:10:10 -07:00 |
|
|
Ishaan Jaff
|
1765976ce0
|
use with base64
|
2024-08-22 20:49:39 -07:00 |
|
|
Ishaan Jaff
|
ed2d3f4bf8
|
allow load testing sagemaker url
|
2024-08-22 20:03:27 -07:00 |
|
|
Krrish Dholakia
|
3f96a8c667
|
bump: version 1.44.3 → 1.44.4
v1.44.4
|
2024-08-22 19:31:35 -07:00 |
|
|
Krish DholakiaandGitHub
|
0a5fc42f5c
|
Merge pull request #5337 from BerriAI/litellm_azure_batch_apis
feat(batches): add azure openai batches endpoint support
|
2024-08-22 19:08:00 -07:00 |
|
|
Krish DholakiaandGitHub
|
76b3db334b
|
Merge branch 'main' into litellm_azure_batch_apis
|
2024-08-22 19:07:54 -07:00 |
|
|
Ishaan Jaff
|
b054dd0e45
|
docs fix
|
2024-08-22 19:04:14 -07:00 |
|
|
Ishaan Jaff
|
25609a94ad
|
docs moderation
|
2024-08-22 18:57:54 -07:00 |
|
|
Krrish Dholakia
|
56cb94ac5e
|
docs(batches.md): add more examples to docs
|
2024-08-22 18:51:44 -07:00 |
|
|
Ishaan Jaff
|
b865993b34
|
docs move pass thru endpoints
|
2024-08-22 18:49:26 -07:00 |
|
|
Ishaan Jaff
|
18cd905a1f
|
ci/cd run again
v1.44.3
|
2024-08-22 18:41:10 -07:00 |
|
|
Ishaan Jaff
|
95beba870e
|
bump: version 1.44.2 → 1.44.3
|
2024-08-22 18:27:38 -07:00 |
|
|
Krrish Dholakia
|
11c7e92b58
|
docs(sidebars.js): refactor docs
|
2024-08-22 18:22:50 -07:00 |
|
|
Ishaan JaffandGitHub
|
645da5b437
|
Merge pull request #5332 from BerriAI/litellm_allow_using_azure_ad_token_auth
[Feat] Azure OpenAI add support for using azure_ad_token_provider with LiteLLM Proxy + Router
|
2024-08-22 18:21:54 -07:00 |
|
|
Ishaan JaffandGitHub
|
228252b92d
|
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth
|
2024-08-22 18:21:24 -07:00 |
|
|
Ishaan Jaff
|
2bf1fb3275
|
add test for test_azure_tenant_id_auth
|
2024-08-22 18:09:00 -07:00 |
|
|
Ishaan JaffandGitHub
|
2d57fab79f
|
Merge pull request #5339 from BerriAI/litellm_add_bedrock_guardrails
[Feat-Proxy] add bedrock guardrails support
|
2024-08-22 17:28:57 -07:00 |
|
|
Ishaan JaffandGitHub
|
70f9e41ed9
|
Merge branch 'main' into litellm_add_bedrock_guardrails
|
2024-08-22 17:28:49 -07:00 |
|
|
Ishaan Jaff
|
1f0cc72531
|
test bedrock guardrails
|
2024-08-22 17:24:42 -07:00 |
|
|
Krrish Dholakia
|
e445b78490
|
docs(configs.md): add global_max_parallel_requests to docs
|
2024-08-22 17:12:52 -07:00 |
|
|
Krrish Dholakia
|
735fc804ed
|
fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit
|
2024-08-22 16:49:52 -07:00 |
|
|
Krrish Dholakia
|
7398e94472
|
fix(files_endpoints.py): fix multiple args error
|
2024-08-22 16:42:44 -07:00 |
|
|
Krrish Dholakia
|
d7b525f391
|
feat(auth_checks.py): allow team to call all models, when explicitly set via /*
|
2024-08-22 16:38:56 -07:00 |
|
|
Ishaan Jaff
|
9e3d573bcb
|
add async_post_call_success_hook
|
2024-08-22 16:34:43 -07:00 |
|
|
Ishaan Jaff
|
499b6b3368
|
doc bedrock guardrails
|
2024-08-22 16:25:22 -07:00 |
|
|
Ishaan Jaff
|
f13a65be2d
|
fix azure_ad_token_provider
|
2024-08-22 16:15:53 -07:00 |
|
|
Krish DholakiaandGitHub
|
3cf009efbf
|
Merge pull request #5325 from BerriAI/litellm_redis_cluster
feat(caching.py): redis cluster support
|
2024-08-22 16:13:45 -07:00 |
|
|
Krrish Dholakia
|
d7d3eee349
|
feat(azure.py): support health checking azure deployments
Fixes https://github.com/BerriAI/litellm/issues/5279
|
2024-08-22 16:11:14 -07:00 |
|
|
Ishaan Jaff
|
7d55047ab9
|
add bedrock guardrails support
|
2024-08-22 16:09:55 -07:00 |
|
|
Krrish Dholakia
|
63cd94c32a
|
fix: fix linting errors
|
2024-08-22 15:51:59 -07:00 |
|
|
Krish DholakiaandGitHub
|
5b7fbc44be
|
Merge pull request #5336 from micpst/docs-dbally
docs(projects): add dbally to sidebar
|
2024-08-22 15:49:16 -07:00 |
|
|
Ishaan Jaff
|
14a6ce367d
|
add types for BedrockMessage
|
2024-08-22 15:40:58 -07:00 |
|
|
Krrish Dholakia
|
8625663458
|
feat(proxy_server.py): support azure batch api endpoints
|
2024-08-22 15:21:43 -07:00 |
|
|
Krrish Dholakia
|
ada426d652
|
docs(batches.md): add docs on calling azure batches api
|
2024-08-22 14:51:14 -07:00 |
|
|
Krrish Dholakia
|
80675b22bd
|
feat(batches): add azure openai batches endpoint support
Closes https://github.com/BerriAI/litellm/issues/5073
|
2024-08-22 14:46:51 -07:00 |
|
|
Michał Pstrąg
|
a37f004c1d
|
Merge branch 'main' into docs-dbally
|
2024-08-22 23:25:57 +02:00 |
|
|
Michał Pstrąg
|
62df7c755b
|
add dbally project
|
2024-08-22 23:21:40 +02:00 |
|
|
Ishaan JaffandGitHub
|
8dbcdafe4b
|
Merge pull request #5335 from BerriAI/litellm_add_metrics_latency
[Feat-Proxy] Prometheus Metrics to Track request latency, track llm api latency
|
2024-08-22 14:10:19 -07:00 |
|
|
Ishaan Jaff
|
57707b04b6
|
add prom docs for Request Latency Metrics
|
2024-08-22 14:06:14 -07:00 |
|
|
Ishaan Jaff
|
36b550b8db
|
update promtheus metric names
|
2024-08-22 14:03:00 -07:00 |
|
|
Ishaan Jaff
|
06a362d35f
|
track litellm_request_latency_metric
|
2024-08-22 13:58:10 -07:00 |
|
|
Ishaan Jaff
|
e2cdb00a81
|
track api_call_start_time
|
2024-08-22 13:52:03 -07:00 |
|
|
Ishaan Jaff
|
65c0626aa4
|
fix init correct prometheus metrics
|
2024-08-22 13:29:35 -07:00 |
|
|
Ishaan Jaff
|
38ce14c66b
|
docs use entrata id with litellm proxy
|
2024-08-22 13:20:05 -07:00 |
|
|
Ishaan Jaff
|
08fa3f346a
|
add new litellm params for client_id, tenant_id etc
|
2024-08-22 11:37:30 -07:00 |
|
|
Krrish Dholakia
|
a63c5c0020
|
docs(azure_ai.md): add azure ai jamba instruct to docs
Closes https://github.com/BerriAI/litellm/issues/5333
|
2024-08-22 11:34:52 -07:00 |
|
|
Krish DholakiaandGitHub
|
68cb5cae58
|
Merge branch 'main' into litellm_redis_cluster
|
2024-08-22 11:06:14 -07:00 |
|
|
Krrish Dholakia
|
98f73b35ba
|
docs(utils.py): cleanup docstring
|
2024-08-22 11:05:25 -07:00 |
|