 Ishaan Jaff
|
68b54bed85
|
add tpm limits per api key per model
|
2024-08-17 13:20:55 -07:00 |
|
|
Ishaan Jaff
|
fa96610bbc
|
fix async_pre_call_hook in parallel request limiter
|
2024-08-17 12:42:28 -07:00 |
|
|
Ishaan Jaff
|
feb8c3c5b4
|
Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header
[Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers
|
2024-08-17 12:41:16 -07:00 |
|
|
Ishaan Jaff
|
ee0f772b5c
|
feat return rmng tokens for model for api key
|
2024-08-17 12:35:10 -07:00 |
|
|
Ishaan Jaff
|
5985c7e933
|
feat - use commong helper for getting model group
|
2024-08-17 10:46:04 -07:00 |
|
|
Ishaan Jaff
|
d630f77b73
|
show correct metric
|
2024-08-17 10:12:23 -07:00 |
|
|
Ishaan Jaff
|
412d30d362
|
add litellm-key-remaining-tokens on prometheus
|
2024-08-17 10:02:20 -07:00 |
|
|
Ishaan Jaff
|
785482f023
|
feat add settings for rpm/tpm limits for a model
|
2024-08-17 09:16:01 -07:00 |
|
|
Krrish Dholakia
|
b56ecd7e02
|
fix(pass_through_endpoints.py): fix returned response headers for pass-through endpoitns
|
2024-08-17 09:00:00 -07:00 |
|
|
Krrish Dholakia
|
08411f37b4
|
docs(vertex_ai.md): cleanup docs
|
2024-08-17 08:38:01 -07:00 |
|
|
Krrish Dholakia
|
b1bed459b4
|
bump: version 1.43.16 → 1.43.17
v1.43.17
|
2024-08-16 21:34:35 -07:00 |
|
|
Krish Dholakia
|
75af146f0e
|
Merge pull request #5254 from BerriAI/litellm_log_model_price_information
s3 - Log model price information
|
2024-08-16 19:34:23 -07:00 |
|
|
Krish Dholakia
|
f3e17cd692
|
Merge branch 'main' into litellm_log_model_price_information
|
2024-08-16 19:34:16 -07:00 |
|
|
Krish Dholakia
|
a8dd2b6910
|
Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
|
2024-08-16 19:16:20 -07:00 |
|
|
Krish Dholakia
|
6b1be4783a
|
Merge pull request #5251 from Manouchehri/oidc-improvements-20240816
(oidc): Add support for loading tokens via a file, env var, and path in env var
|
2024-08-16 19:15:31 -07:00 |
|
|
Ishaan Jaff
|
1ee33478c9
|
track rpm/tpm usage per key+model
|
2024-08-16 18:28:58 -07:00 |
|
|
Ishaan Jaff
|
a6a4b944ad
|
user api key auth rpm_limit_per_model
|
2024-08-16 18:22:35 -07:00 |
|
|
Krrish Dholakia
|
d991e1320c
|
docs(langfuse_integration.md): add disable logging for specific calls to docs
|
2024-08-16 17:36:13 -07:00 |
|
|
Krish Dholakia
|
6cf8c47366
|
Merge pull request #5255 from BerriAI/litellm_fix_token_counter
fix(utils.py): fix get_image_dimensions to handle more image types
|
2024-08-16 17:27:27 -07:00 |
|
|
Krrish Dholakia
|
7fce6b0163
|
fix(health_check.py): return 'missing mode' error message, if error with health check, and mode is missing
|
2024-08-16 17:24:29 -07:00 |
|
|
Ishaan Jaff
|
51da6ab64e
|
fix databricks streaming test
v1.43.16-stable
v1.43.16
|
2024-08-16 16:56:08 -07:00 |
|
|
Krrish Dholakia
|
a92dcdd2d6
|
fix(litellm_logging.py): fix price information logging to s3
|
2024-08-16 16:42:38 -07:00 |
|
|
Krrish Dholakia
|
178139f18d
|
feat(litellm_logging.py): support logging model price information to s3 logs
|
2024-08-16 16:21:34 -07:00 |
|
|
Ishaan Jaff
|
5d1fcc545b
|
fix predictions image generation response
|
2024-08-16 15:06:12 -07:00 |
|
|
Ishaan Jaff
|
31f9453618
|
skip InternalServerError on vertex test
|
2024-08-16 14:51:51 -07:00 |
|
|
Ishaan Jaff
|
cff01b2de3
|
Merge pull request #5243 from BerriAI/litellm_add_bedrock_traces_in_response
[Feat] Add bedrock Guardrail `traces ` in response when trace=enabled
|
2024-08-16 14:49:20 -07:00 |
|
|
Ishaan Jaff
|
84925264d8
|
docs oauth2
|
2024-08-16 14:03:56 -07:00 |
|
|
Ishaan Jaff
|
3d06b51e4e
|
docs correct link to oauth 2.0
|
2024-08-16 14:02:58 -07:00 |
|
|
Ishaan Jaff
|
c5e5bd20ac
|
Merge pull request #5252 from BerriAI/litellm_allow_auth_oauth_2
[Feat-Proxy] Add Oauth 2.0 Support
|
2024-08-16 14:01:06 -07:00 |
|
|
Ishaan Jaff
|
ac833f415d
|
docs oauh 2.0 enterprise feature
|
2024-08-16 14:00:24 -07:00 |
|
|
Ishaan Jaff
|
0d41e2972b
|
docs on oauth 2.0
|
2024-08-16 13:55:28 -07:00 |
|
|
Ishaan Jaff
|
cd28b6607e
|
add debugging for oauth2.0
|
2024-08-16 13:40:32 -07:00 |
|
|
Ishaan Jaff
|
d4b33cf87c
|
allow using oauth2 checks for logging into proxy
|
2024-08-16 13:36:29 -07:00 |
|
|
David Manouchehri
|
bef8568cb3
|
(oidc): Improve docs for unofficial provider.
|
2024-08-16 20:30:41 +00:00 |
|
|
Ishaan Jaff
|
0c0b835c3f
|
add init commit for oauth 2 checks
|
2024-08-16 13:30:22 -07:00 |
|
|
David Manouchehri
|
11668c31c1
|
(oidc): Add support for loading tokens via a file, environment variable, and from a file path set in an env var.
|
2024-08-16 20:13:07 +00:00 |
|
|
Ishaan Jaff
|
9c3124c5a7
|
ui new build
|
2024-08-16 12:53:23 -07:00 |
|
|
Ishaan Jaff
|
bd7bf7f6b0
|
fix endpoint name on router
|
2024-08-16 12:46:43 -07:00 |
|
|
Ishaan Jaff
|
f92cabbceb
|
Merge pull request #5250 from BerriAI/docs_sagemaker_docs
[Docs] Sagemaker add example on using with LiteLLM Proxy and temperature=0
|
2024-08-16 12:43:02 -07:00 |
|
|
Ishaan Jaff
|
dcd8ff44df
|
docs add example on setting temp=0 for sagemaker
|
2024-08-16 12:04:35 -07:00 |
|
|
Krrish Dholakia
|
7129e93992
|
fix(utils.py): fix get_image_dimensions to handle more image types
Fixes https://github.com/BerriAI/litellm/issues/5205
|
2024-08-16 12:00:04 -07:00 |
|
|
Ishaan Jaff
|
63b4e11bfd
|
docs sagemaker - add example using with proxy
|
2024-08-16 11:47:13 -07:00 |
|
|
Ishaan Jaff
|
7f39f9f97d
|
docs cleanup
|
2024-08-16 11:38:53 -07:00 |
|
|
Ishaan Jaff
|
740d1fdb1c
|
add provider_specific_fields to GenericStreamingChunk
|
2024-08-16 11:38:22 -07:00 |
|
|
Ishaan Jaff
|
9851fa7b1b
|
return traces in bedrock guardrails when enabled
|
2024-08-16 11:35:43 -07:00 |
|
|
Krrish Dholakia
|
cbdaecb5a8
|
fix(__init__.py): fix models_by_provider to include cohere_chat models
Fixes https://github.com/BerriAI/litellm/issues/5201
|
2024-08-16 11:33:23 -07:00 |
|
|
Krrish Dholakia
|
61f4b71ef7
|
refactor: replace .error() with .exception() logging for better debugging on sentry
|
2024-08-16 09:22:47 -07:00 |
|
|
Ishaan Jaff
|
89ba7b3e11
|
pass trace through for bedrock guardrails
|
2024-08-16 09:10:56 -07:00 |
|
|
Ishaan Jaff
|
3d7e3d65d0
|
Merge pull request #5135 from BerriAI/dependabot/pip/aiohttp-3.10.2
build(deps): bump aiohttp from 3.9.4 to 3.10.2
|
2024-08-16 09:07:02 -07:00 |
|
|
Ishaan Jaff
|
374a46d924
|
Merge pull request #5173 from gitravin/rn/sagemaker-zero-temp
Allow zero temperature for Sagemaker models based on config
|
2024-08-16 08:45:44 -07:00 |
|