 Ishaan Jaff
|
671663abe6
|
docs rate limits per model per api key
|
2024-08-17 14:50:17 -07:00 |
|
|
Krish Dholakia
|
be37310e94
|
Merge pull request #5232 from Penagwin/fix_anthropic_tool_streaming_index
Fixes the `tool_use` indexes not being correctly mapped
|
2024-08-17 14:33:50 -07:00 |
|
|
Ishaan Jaff
|
a60fc3ad70
|
Merge pull request #5261 from BerriAI/litellm_set_model_rpm_tpm_limit
[Feat-Proxy] set rpm/tpm limits per api key per model
|
2024-08-17 14:30:54 -07:00 |
|
|
Ishaan Jaff
|
653d2e6ce0
|
fix parallel request limiter tests
|
2024-08-17 14:21:59 -07:00 |
|
|
Ishaan Jaff
|
221e5b829b
|
fix parallel request limiter
|
2024-08-17 14:14:12 -07:00 |
|
|
Krish Dholakia
|
5731287f1b
|
Merge pull request #5221 from kiriloman/adjust-pricing-file
[PRICING] Use specific llama2 and llama3 model names in Ollama
|
2024-08-17 14:03:20 -07:00 |
|
|
Krish Dholakia
|
1a3b686580
|
Merge pull request #5219 from dhlidongming/fix-messages-length-check
Fix incorrect message length check in cost calculator
|
2024-08-17 14:01:59 -07:00 |
|
|
Krish Dholakia
|
ff6ff133ee
|
Merge pull request #5260 from BerriAI/google_ai_studio_pass_through
Pass-through endpoints for Gemini - Google AI Studio
|
2024-08-17 13:51:51 -07:00 |
|
|
Krrish Dholakia
|
0df41653f3
|
docs(google_ai_studio.md): add docs on google ai studio pass through endpoints
|
2024-08-17 13:47:05 -07:00 |
|
|
Ishaan Jaff
|
b35b09ea93
|
docs clean up emojis
|
2024-08-17 13:30:11 -07:00 |
|
|
Ishaan Jaff
|
9b0bd54571
|
docs cleanup - reduce emojis
|
2024-08-17 13:28:34 -07:00 |
|
|
Ishaan Jaff
|
68b54bed85
|
add tpm limits per api key per model
|
2024-08-17 13:20:55 -07:00 |
|
|
Krrish Dholakia
|
fd44cf8d26
|
feat(pass_through_endpoints.py): support streaming requests
|
2024-08-17 12:46:57 -07:00 |
|
|
Ishaan Jaff
|
fa96610bbc
|
fix async_pre_call_hook in parallel request limiter
|
2024-08-17 12:42:28 -07:00 |
|
|
Ishaan Jaff
|
feb8c3c5b4
|
Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header
[Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers
|
2024-08-17 12:41:16 -07:00 |
|
|
Ishaan Jaff
|
ee0f772b5c
|
feat return rmng tokens for model for api key
|
2024-08-17 12:35:10 -07:00 |
|
|
Krrish Dholakia
|
bc0023a409
|
feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests
New Feature
|
2024-08-17 10:46:59 -07:00 |
|
|
Ishaan Jaff
|
5985c7e933
|
feat - use commong helper for getting model group
|
2024-08-17 10:46:04 -07:00 |
|
|
Ishaan Jaff
|
d630f77b73
|
show correct metric
|
2024-08-17 10:12:23 -07:00 |
|
|
Ishaan Jaff
|
412d30d362
|
add litellm-key-remaining-tokens on prometheus
|
2024-08-17 10:02:20 -07:00 |
|
|
Ishaan Jaff
|
785482f023
|
feat add settings for rpm/tpm limits for a model
|
2024-08-17 09:16:01 -07:00 |
|
|
Krrish Dholakia
|
b56ecd7e02
|
fix(pass_through_endpoints.py): fix returned response headers for pass-through endpoitns
|
2024-08-17 09:00:00 -07:00 |
|
|
Krrish Dholakia
|
08411f37b4
|
docs(vertex_ai.md): cleanup docs
|
2024-08-17 08:38:01 -07:00 |
|
|
Krrish Dholakia
|
b1bed459b4
|
bump: version 1.43.16 → 1.43.17
v1.43.17
|
2024-08-16 21:34:35 -07:00 |
|
|
Krish Dholakia
|
75af146f0e
|
Merge pull request #5254 from BerriAI/litellm_log_model_price_information
s3 - Log model price information
|
2024-08-16 19:34:23 -07:00 |
|
|
Krish Dholakia
|
f3e17cd692
|
Merge branch 'main' into litellm_log_model_price_information
|
2024-08-16 19:34:16 -07:00 |
|
|
Krish Dholakia
|
a8dd2b6910
|
Merge pull request #5244 from BerriAI/litellm_better_error_logging_sentry
refactor: replace .error() with .exception() logging for better debugging on sentry
|
2024-08-16 19:16:20 -07:00 |
|
|
Krish Dholakia
|
6b1be4783a
|
Merge pull request #5251 from Manouchehri/oidc-improvements-20240816
(oidc): Add support for loading tokens via a file, env var, and path in env var
|
2024-08-16 19:15:31 -07:00 |
|
|
Ishaan Jaff
|
1ee33478c9
|
track rpm/tpm usage per key+model
|
2024-08-16 18:28:58 -07:00 |
|
|
Ishaan Jaff
|
a6a4b944ad
|
user api key auth rpm_limit_per_model
|
2024-08-16 18:22:35 -07:00 |
|
|
Krrish Dholakia
|
d991e1320c
|
docs(langfuse_integration.md): add disable logging for specific calls to docs
|
2024-08-16 17:36:13 -07:00 |
|
|
Krish Dholakia
|
6cf8c47366
|
Merge pull request #5255 from BerriAI/litellm_fix_token_counter
fix(utils.py): fix get_image_dimensions to handle more image types
|
2024-08-16 17:27:27 -07:00 |
|
|
Krrish Dholakia
|
7fce6b0163
|
fix(health_check.py): return 'missing mode' error message, if error with health check, and mode is missing
|
2024-08-16 17:24:29 -07:00 |
|
|
Ishaan Jaff
|
51da6ab64e
|
fix databricks streaming test
v1.43.16-stable
v1.43.16
|
2024-08-16 16:56:08 -07:00 |
|
|
Krrish Dholakia
|
a92dcdd2d6
|
fix(litellm_logging.py): fix price information logging to s3
|
2024-08-16 16:42:38 -07:00 |
|
|
Krrish Dholakia
|
178139f18d
|
feat(litellm_logging.py): support logging model price information to s3 logs
|
2024-08-16 16:21:34 -07:00 |
|
|
Ishaan Jaff
|
5d1fcc545b
|
fix predictions image generation response
|
2024-08-16 15:06:12 -07:00 |
|
|
Ishaan Jaff
|
31f9453618
|
skip InternalServerError on vertex test
|
2024-08-16 14:51:51 -07:00 |
|
|
Ishaan Jaff
|
cff01b2de3
|
Merge pull request #5243 from BerriAI/litellm_add_bedrock_traces_in_response
[Feat] Add bedrock Guardrail `traces ` in response when trace=enabled
|
2024-08-16 14:49:20 -07:00 |
|
|
Ishaan Jaff
|
84925264d8
|
docs oauth2
|
2024-08-16 14:03:56 -07:00 |
|
|
Ishaan Jaff
|
3d06b51e4e
|
docs correct link to oauth 2.0
|
2024-08-16 14:02:58 -07:00 |
|
|
Ishaan Jaff
|
c5e5bd20ac
|
Merge pull request #5252 from BerriAI/litellm_allow_auth_oauth_2
[Feat-Proxy] Add Oauth 2.0 Support
|
2024-08-16 14:01:06 -07:00 |
|
|
Ishaan Jaff
|
ac833f415d
|
docs oauh 2.0 enterprise feature
|
2024-08-16 14:00:24 -07:00 |
|
|
Ishaan Jaff
|
0d41e2972b
|
docs on oauth 2.0
|
2024-08-16 13:55:28 -07:00 |
|
|
Ishaan Jaff
|
cd28b6607e
|
add debugging for oauth2.0
|
2024-08-16 13:40:32 -07:00 |
|
|
Ishaan Jaff
|
d4b33cf87c
|
allow using oauth2 checks for logging into proxy
|
2024-08-16 13:36:29 -07:00 |
|
|
David Manouchehri
|
bef8568cb3
|
(oidc): Improve docs for unofficial provider.
|
2024-08-16 20:30:41 +00:00 |
|
|
Ishaan Jaff
|
0c0b835c3f
|
add init commit for oauth 2 checks
|
2024-08-16 13:30:22 -07:00 |
|
|
David Manouchehri
|
11668c31c1
|
(oidc): Add support for loading tokens via a file, environment variable, and from a file path set in an env var.
|
2024-08-16 20:13:07 +00:00 |
|
|
Ishaan Jaff
|
9c3124c5a7
|
ui new build
|
2024-08-16 12:53:23 -07:00 |
|