Commit Graph
22289 Commits
Author SHA1 Message Date
Ishaan Jaff 15ea80d2cf ui new build v1.71.3-nightly 2025-05-30 23:08:07 -07:00
Ishaan Jaff c5873c6f1f UI QA fixes/cleanup 2025-05-30 23:06:45 -07:00
Ishaan Jaff 310d97c982 fix: fix linting error 2025-05-30 22:51:10 -07:00
Ishaan JaffandGitHub d7f19bbfe3 [Bug]: Performance Fix Max langfuse clients reached: 20 is greater than 20 (#11285)
* fix: initializing langfuse clients

* fix: initializing langfuse clients

* tests: tests for langfuse cache
2025-05-30 22:34:39 -07:00
7e49b4e2a0 [Feat] Enforce Vector Store Access Controls on LiteLLM Auth (#11281)
* fix LiteLLM_ObjectPermissionTable

* fix include object_permission for list key

* fix key list to inclue obj permissions

* fix object permissions for vector stores on key info

* add key edit view with vector stores

* allow editing vector stores permissions

* fixes obj permissions

* feat: add obj permission on UI

* fix: add object_permission:true

* ui show org vector stores on org info

* fix: show object permissions on /org/info

* feat: allow updating obj permissions for keys

* fixes: key object permissions

* fixes: team object permissions

* fixes: org object permissions

* fix vector store selector for Orgs

* feat: add auth checks for vector store permissions

* feat: working auth checks for vector store permissions

* test vector stores auth checks

* Update litellm/proxy/_types.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: linting

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-30 22:20:11 -07:00
Ishaan JaffandGitHub 2f8eb1dcc3 fix: dont require mcp pip for proxy (#11282) 2025-05-30 22:19:53 -07:00
Isaac WhitfieldandGitHub c698cc24aa Streamline session expiration in UI (#11279) 2025-05-30 17:26:23 -07:00
Ishaan JaffandGitHub a9d23f5d4a [Fix] Bedrock Guard Auth Param Persistence (#11270)
* fix: using bedrock guard

* fix: bedrock guard param persistence
2025-05-30 17:24:03 -07:00
Ishaan JaffandGitHub ea841eeb9b [Feat] UI - show vector store permissions for Key, Team, Org (#11277)
* fix LiteLLM_ObjectPermissionTable

* fix include object_permission for list key

* fix key list to inclue obj permissions

* fix object permissions for vector stores on key info

* add key edit view with vector stores

* allow editing vector stores permissions

* fixes obj permissions

* feat: add obj permission on UI

* fix: add object_permission:true

* ui show org vector stores on org info

* fix: show object permissions on /org/info

* feat: allow updating obj permissions for keys

* fixes: key object permissions

* fixes: team object permissions

* fixes: org object permissions

* fix vector store selector for Orgs
2025-05-30 17:23:50 -07:00
Ishaan Jaff b13d1b3ff1 ci/cd: run again 2025-05-30 09:06:03 -07:00
44a69421ea Anthropic - Files API w/ form-data support on passthrough + File ID support on /chat/completion (#11256)
* fix(anthropic/chat): support passing 'file_id' param to anthropic

Partial fix for LIT-200

* feat(anthropic/chat): use correct anthropic content block based on file object

* fix(anthropic/chat): fix file id for container_upload message type

* fix(anthropic/chat/transformation.py): fix check for adding code execution to tool calls - needed for 'container_upload' message type

* fix(llm_passthrough_endpoints.py): support reading form data for anthropic passthrough

* refactor(llm_passthrough_endpoints.py): refactor block into function for easier testing

* test: add unit test

* fix: don't pass in empty tools list

* [Fix] Responses API - Session management  (#11254)

* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* bump: bump litellm enterprise

* fixes: test_create_user_default_budget

* fix: fix linting error

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 23:54:24 -07:00
5d4ae9aa4d Support dropping non-openai params when specified in additional_drop_params + Add VertexAI Anthropic support on /v1/messages (#11246)
* feat(utils.py): support dropping non-openai params when specified via additional drop params

Closes https://github.com/BerriAI/litellm/issues/11205

* fix(utils.py): fix linting error

* refactor(handler.py): add custom llm provider to anthropic messages provider config exception

* feat: initial commit adding vertex ai anthropic support on `/v1/messages`

* test: add working unit test

* test(vertex_ai_partner_models/anthropic): add /v1/messages support for anthropic api

Adds vertex ai auth

* feat(vertex_ai/anthropic): return correct url when calling via `/v1/messages`

* fix: more alignment to expected anthropic request format

* fix: fix ruff linting check

* Removed syntax error from docs (#11242)

* [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239)

* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests

* fix: import session handling

* Revert "fix: import session handling"

This reverts commit deb257dc10.

* fix: linting pin mypy

* [Feat]: Guardrails - Add streaming for bedrock post guard (#11247)

* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* [Fix] Responses API - Session management  (#11254)

* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* bump: bump litellm enterprise

* fixes: test_create_user_default_budget

* fix: fix linting error

* fix: fix linting error

---------

Co-authored-by: Fadil Rahman <87557055+fadil4u@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
v1.71.2.dev3
2025-05-29 23:42:48 -07:00
Ishaan Jaff c9062ac044 fixes: test_create_user_default_budget 2025-05-29 21:12:28 -07:00
Ishaan Jaff afb75dc50c bump: bump litellm enterprise 2025-05-29 20:41:03 -07:00
7fcbb38d91 [Fix] Responses API - Session management (#11254)
* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:36:02 -07:00
f24d8919c4 [Feat]: Guardrails - Add streaming for bedrock post guard (#11247)
* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:01:44 -07:00
Ishaan Jaff 62a083de02 fix: linting pin mypy 2025-05-29 19:58:31 -07:00
Ishaan Jaff 0d4c85c419 Revert "fix: import session handling"
This reverts commit deb257dc10.
2025-05-29 17:54:24 -07:00
Ishaan Jaff deb257dc10 fix: import session handling 2025-05-29 17:48:34 -07:00
Ishaan JaffandGitHub 5e6f6ddc52 [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239)
* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests
2025-05-29 16:48:55 -07:00
Fadil RahmanandGitHub dd8d23be62 Removed syntax error from docs (#11242) 2025-05-29 15:34:16 -07:00
Krrish Dholakia 368e59181d docs(entity_usage.tsx): fix bad link 2025-05-29 11:00:18 -07:00
AnilArenandGitHub 9a82a69593 fix: bedrock ai21 jamba models will work now (#11233) 2025-05-29 08:31:05 -07:00
VigneshwarRajasekaranandGitHub 974c928672 changed model name is request and updating to latest response format in proxy quick start guide as 3.5 turbo is retired and leads to error when a call is made using liteLLM to respective Azure-openAI endpoints. (#11223) 2025-05-29 08:27:56 -07:00
Emmanuel FerdmanandGitHub 7dcfde2a1c fix the litellm CLA reference (#11230)
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
2025-05-29 08:27:14 -07:00
Krrish Dholakia dececb84c1 docs(image_edits.md): clarify proxy version support for image edits 2025-05-29 07:50:41 -07:00
Krrish Dholakia 077b69eafa fix(key_management_endpoints.py): allow master key rotations for OSS users
Closes https://github.com/BerriAI/litellm/issues/11210
2025-05-28 22:56:25 -07:00
Krish DholakiaandGitHub 8fb2779c9e build(model_prices_and_context_window.json): add supports parallel function calling to all gemini models (#11225) 2025-05-28 22:32:02 -07:00
Krish DholakiaandGitHub 1995c7aad5 fix(utils.py): support non default params for audio transcription (#11212)
* fix(utils.py): support non default params for audio transcription

allows passing provider specific params straight through on transcription calls

* fix(gpt_transformation.py): fix o_series model routing

call _transform_request on async event

* refactor: refactor tests

* test(test_azure_chat_o_series_transformation.py): add unit test for azure o series error

* test: update test

* test: update json

* fix: fix mutiple keyword error
2025-05-28 22:24:02 -07:00
Krish DholakiaandGitHub ba39f9e360 Helicone base url support + fix for embedding cache hits on str input (#11211)
* fix(helicone.py): add helicone api base support

Fixes https://github.com/BerriAI/litellm/issues/10825

* test: add unit test for cache hit response on embedding calls

* fix(caching_handler.py): fix handling cache hit on embedding when input is string

Fixes LIT-197

* docs(helicone_integration.md): document new helicone api base param
2025-05-28 22:02:55 -07:00
Krrish Dholakia 75f591a6e2 docs(cli.md): add new skip_server_startup flag 2025-05-28 21:47:08 -07:00
Ishaan Jaff 2e5f635803 bump: version 1.71.2 → 1.71.3 2025-05-28 21:39:14 -07:00
Ishaan Jaff 2372492237 test: fix test_user_email_metrics 2025-05-28 21:30:47 -07:00
Ishaan Jaff 226c3b74ba build: fix ui build 2025-05-28 21:26:18 -07:00
Ishaan Jaff 711c931c71 test: fix test_key_generation_with_object_permission 2025-05-28 21:24:35 -07:00
Ishaan Jaff c5a82b03f4 Revert "(build) fix ui build"
This reverts commit 73a82d24d8.
2025-05-28 21:21:10 -07:00
Ishaan Jaff 7ac05087c3 Revert "build(deps): bump next from 14.2.26 to 15.2.4 in /ui/litellm-dashboard (#11216)"
This reverts commit 461e1a4751.
2025-05-28 21:20:56 -07:00
Ishaan Jaff f0618fd297 Revert "(ui) fix build"
This reverts commit 90dbf4cf0b.
2025-05-28 21:20:35 -07:00
Ishaan Jaff 90dbf4cf0b (ui) fix build 2025-05-28 21:18:09 -07:00
Ishaan Jaff edf85f2394 fix: code QA check 2025-05-28 21:16:17 -07:00
Ishaan Jaff 73a82d24d8 (build) fix ui build 2025-05-28 21:05:33 -07:00
Ishaan Jaff 745d9acdc3 fix: code QA check 2025-05-28 21:03:33 -07:00
Ishaan Jaff 6b527a77aa ci/cd fix build ui 2025-05-28 21:00:39 -07:00
Ishaan JaffandGitHub 68a2466f3d fix debug langfuse clients started (#11221) 2025-05-28 19:16:52 -07:00
Ishaan Jaff 9e75409518 bump litellm proxy extras v1.71.2.dev1 2025-05-28 18:58:33 -07:00
Ishaan Jaff 5a32fb89b0 build: add vector stores to object permissions 2025-05-28 18:55:05 -07:00
Ishaan Jaff df76b8c7b9 ui new build 2025-05-28 18:53:37 -07:00
Ishaan Jaff b35806d0f0 ui new build 2025-05-28 18:53:01 -07:00
Ishaan JaffandGitHub 096e03bbc6 scim fix - key (#11220) 2025-05-28 18:47:51 -07:00
3960e08dd7 Fix: Remove duplicate object_permission field in LiteLLM_TeamTable (#11219)
This fixes a mypy error where 'object_permission' was already defined on line 1267.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Stephen Solka <stephen@standd.io>
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 18:40:45 -07:00