Commit Graph
22278 Commits
Author SHA1 Message Date
5d4ae9aa4d Support dropping non-openai params when specified in additional_drop_params + Add VertexAI Anthropic support on /v1/messages (#11246)
* feat(utils.py): support dropping non-openai params when specified via additional drop params

Closes https://github.com/BerriAI/litellm/issues/11205

* fix(utils.py): fix linting error

* refactor(handler.py): add custom llm provider to anthropic messages provider config exception

* feat: initial commit adding vertex ai anthropic support on `/v1/messages`

* test: add working unit test

* test(vertex_ai_partner_models/anthropic): add /v1/messages support for anthropic api

Adds vertex ai auth

* feat(vertex_ai/anthropic): return correct url when calling via `/v1/messages`

* fix: more alignment to expected anthropic request format

* fix: fix ruff linting check

* Removed syntax error from docs (#11242)

* [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239)

* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests

* fix: import session handling

* Revert "fix: import session handling"

This reverts commit deb257dc10.

* fix: linting pin mypy

* [Feat]: Guardrails - Add streaming for bedrock post guard (#11247)

* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* [Fix] Responses API - Session management  (#11254)

* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* bump: bump litellm enterprise

* fixes: test_create_user_default_budget

* fix: fix linting error

* fix: fix linting error

---------

Co-authored-by: Fadil Rahman <87557055+fadil4u@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
v1.71.2.dev3
2025-05-29 23:42:48 -07:00
Ishaan Jaff c9062ac044 fixes: test_create_user_default_budget 2025-05-29 21:12:28 -07:00
Ishaan Jaff afb75dc50c bump: bump litellm enterprise 2025-05-29 20:41:03 -07:00
7fcbb38d91 [Fix] Responses API - Session management (#11254)
* fix: import session handling

* fix: imports for session handler

* tests: tests for session handler

* Update enterprise/litellm_enterprise/enterprise_callbacks/session_handler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:36:02 -07:00
f24d8919c4 [Feat]: Guardrails - Add streaming for bedrock post guard (#11247)
* feat: add streaming for bedrock post guard

* fix: bedrock guardrails

* fix: add clear comments

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update litellm/proxy/guardrails/guardrail_hooks/bedrock_guardrails.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: clean up bedrock guardrails

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-29 20:01:44 -07:00
Ishaan Jaff 62a083de02 fix: linting pin mypy 2025-05-29 19:58:31 -07:00
Ishaan Jaff 0d4c85c419 Revert "fix: import session handling"
This reverts commit deb257dc10.
2025-05-29 17:54:24 -07:00
Ishaan Jaff deb257dc10 fix: import session handling 2025-05-29 17:48:34 -07:00
Ishaan JaffandGitHub 5e6f6ddc52 [Feat]: Add Bedrock InvokeAgents as a /chat/completions route on LiteLLM (#11239)
* feat: init structure for bedrock AGENTs

* feat: add basic  routing for bedrock AGENTs

* feat: add basic transforms for bedrock AGENTs

* fix: url for bedrock agent runtime

* fix: working agents request

* feat: working agents non-streaming request

* feat: bedrock agents

* feat: add streaming for bedrock agents

* feat: add cost tracking for bedrock agents

* docs litellm with bedrock agents

* fix: linting errors

* test: invoke agents tests
2025-05-29 16:48:55 -07:00
Fadil RahmanandGitHub dd8d23be62 Removed syntax error from docs (#11242) 2025-05-29 15:34:16 -07:00
Krrish Dholakia 368e59181d docs(entity_usage.tsx): fix bad link 2025-05-29 11:00:18 -07:00
AnilArenandGitHub 9a82a69593 fix: bedrock ai21 jamba models will work now (#11233) 2025-05-29 08:31:05 -07:00
VigneshwarRajasekaranandGitHub 974c928672 changed model name is request and updating to latest response format in proxy quick start guide as 3.5 turbo is retired and leads to error when a call is made using liteLLM to respective Azure-openAI endpoints. (#11223) 2025-05-29 08:27:56 -07:00
Emmanuel FerdmanandGitHub 7dcfde2a1c fix the litellm CLA reference (#11230)
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
2025-05-29 08:27:14 -07:00
Krrish Dholakia dececb84c1 docs(image_edits.md): clarify proxy version support for image edits 2025-05-29 07:50:41 -07:00
Krrish Dholakia 077b69eafa fix(key_management_endpoints.py): allow master key rotations for OSS users
Closes https://github.com/BerriAI/litellm/issues/11210
2025-05-28 22:56:25 -07:00
Krish DholakiaandGitHub 8fb2779c9e build(model_prices_and_context_window.json): add supports parallel function calling to all gemini models (#11225) 2025-05-28 22:32:02 -07:00
Krish DholakiaandGitHub 1995c7aad5 fix(utils.py): support non default params for audio transcription (#11212)
* fix(utils.py): support non default params for audio transcription

allows passing provider specific params straight through on transcription calls

* fix(gpt_transformation.py): fix o_series model routing

call _transform_request on async event

* refactor: refactor tests

* test(test_azure_chat_o_series_transformation.py): add unit test for azure o series error

* test: update test

* test: update json

* fix: fix mutiple keyword error
2025-05-28 22:24:02 -07:00
Krish DholakiaandGitHub ba39f9e360 Helicone base url support + fix for embedding cache hits on str input (#11211)
* fix(helicone.py): add helicone api base support

Fixes https://github.com/BerriAI/litellm/issues/10825

* test: add unit test for cache hit response on embedding calls

* fix(caching_handler.py): fix handling cache hit on embedding when input is string

Fixes LIT-197

* docs(helicone_integration.md): document new helicone api base param
2025-05-28 22:02:55 -07:00
Krrish Dholakia 75f591a6e2 docs(cli.md): add new skip_server_startup flag 2025-05-28 21:47:08 -07:00
Ishaan Jaff 2e5f635803 bump: version 1.71.2 → 1.71.3 2025-05-28 21:39:14 -07:00
Ishaan Jaff 2372492237 test: fix test_user_email_metrics 2025-05-28 21:30:47 -07:00
Ishaan Jaff 226c3b74ba build: fix ui build 2025-05-28 21:26:18 -07:00
Ishaan Jaff 711c931c71 test: fix test_key_generation_with_object_permission 2025-05-28 21:24:35 -07:00
Ishaan Jaff c5a82b03f4 Revert "(build) fix ui build"
This reverts commit 73a82d24d8.
2025-05-28 21:21:10 -07:00
Ishaan Jaff 7ac05087c3 Revert "build(deps): bump next from 14.2.26 to 15.2.4 in /ui/litellm-dashboard (#11216)"
This reverts commit 461e1a4751.
2025-05-28 21:20:56 -07:00
Ishaan Jaff f0618fd297 Revert "(ui) fix build"
This reverts commit 90dbf4cf0b.
2025-05-28 21:20:35 -07:00
Ishaan Jaff 90dbf4cf0b (ui) fix build 2025-05-28 21:18:09 -07:00
Ishaan Jaff edf85f2394 fix: code QA check 2025-05-28 21:16:17 -07:00
Ishaan Jaff 73a82d24d8 (build) fix ui build 2025-05-28 21:05:33 -07:00
Ishaan Jaff 745d9acdc3 fix: code QA check 2025-05-28 21:03:33 -07:00
Ishaan Jaff 6b527a77aa ci/cd fix build ui 2025-05-28 21:00:39 -07:00
Ishaan JaffandGitHub 68a2466f3d fix debug langfuse clients started (#11221) 2025-05-28 19:16:52 -07:00
Ishaan Jaff 9e75409518 bump litellm proxy extras v1.71.2.dev1 2025-05-28 18:58:33 -07:00
Ishaan Jaff 5a32fb89b0 build: add vector stores to object permissions 2025-05-28 18:55:05 -07:00
Ishaan Jaff df76b8c7b9 ui new build 2025-05-28 18:53:37 -07:00
Ishaan Jaff b35806d0f0 ui new build 2025-05-28 18:53:01 -07:00
Ishaan JaffandGitHub 096e03bbc6 scim fix - key (#11220) 2025-05-28 18:47:51 -07:00
3960e08dd7 Fix: Remove duplicate object_permission field in LiteLLM_TeamTable (#11219)
This fixes a mypy error where 'object_permission' was already defined on line 1267.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Stephen Solka <stephen@standd.io>
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 18:40:45 -07:00
Ishaan JaffandGitHub 4e6c4beef8 [Feat] Permission management vector stores on LiteLLM Key, Team, Orgs (#11213)
* fix: init commit for object permissions

* fix: init commit for object permissions

* fix: add vector_store_id to permissions

* fix vector store selector

* feat:add vector store permission mgmt

* feat: ui add allowed vector stores dropdown

* feat: add new vector store object permissions

* testing: key mgmt

* fix: stor vector store permissions on team

* ui select vector store for teams

* ui add vector store settings for orgs

* feat: allow setting org vector store permissions

* test: adding team permissions for vector stores
2025-05-28 16:58:53 -07:00
178a614d4a Add sentry sample rate (#10283)
* Add SENTRY_API_SAMPLE_RATE configuration option for Sentry SDK

* removed print line

* Update Sentry documentation with sample rate information

---------

Co-authored-by: Vinnie <vinnie@Vinnies-MacBook-Pro.local>
2025-05-28 16:44:10 -07:00
Regis David Souza MesquitaandGitHub 56c32ef503 Update mistral-medium prices and context sizes (#10729)
* Update mistral-medium prices and context sizes

While testing the Mistral model, I noticed a discrepancy in the pricing shown on the logs screen. After reviewing the code, I confirmed that the pricing values were incorrect.

This PR corrects the input and output token pricing for the latest Mistral model and adds the newly released mistral-medium-2505 version.

* Adds tool calling flag to mistral-medium

* Adds mistral-medium price updates to the main model price file

* Update model_prices_and_context_window_backup.json

sets mistral medium alias to the old values as it probably points to the old version.

* Update model_prices_and_context_window.json

* Update model_prices_and_context_window_backup.json

* Update model_prices_and_context_window.json
2025-05-28 16:42:28 -07:00
tanjiroandGitHub 14cdf61537 Improve display of model tags on Keys, Teams and Org page (#11022)
* added accordian for models tag

* remove margin top

* match badge styles same as on teams page

* add badge accordian for organizations

* badges fixed on keys page

* fixed for singular and plural

* fix merge conflict
2025-05-28 16:41:26 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
461e1a4751 build(deps): bump next from 14.2.26 to 15.2.4 in /ui/litellm-dashboard (#11216)
Bumps [next](https://github.com/vercel/next.js) from 14.2.26 to 15.2.4.
- [Release notes](https://github.com/vercel/next.js/releases)
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js)
- [Commits](https://github.com/vercel/next.js/compare/v14.2.26...v15.2.4)

---
updated-dependencies:
- dependency-name: next
  dependency-version: 15.2.4
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-28 16:39:20 -07:00
tanjiroandGitHub d8c7dd643d Removed teamInfo call and used existing teamsList call (#11051)
* removed teamInfo call and used existing teams list call

* made perTeamInfo typesafe
2025-05-28 16:39:07 -07:00
tanjiroandGitHub 86409976a9 put all proxy models if no models are selected. (#11187) 2025-05-28 16:31:31 -07:00
Jacob Hagstedt P SuorraandGitHub 7d344c9aee Add price for gpt4o mini audio preview without date at the end of the name, just like for the non mini model (#11207) 2025-05-28 16:30:05 -07:00
9a6d5c119e feat: Allow Adding MCP Servers Through LiteLLM UI (#11208)
* feat: MCP Servers with CRUD operations (#10699)

* feat: mcp CRUD operations with authn/authz

* feat: mcp server UI

* mcp server page with overview, mcp tools, and settings page

* Adding MCP Server flow

* prisma generate before test

* UI callbacks add/remove with api server refetch

* test fix: poetry run prisma

* feat: mcp server db and config connection

* fix: MCPTool filter on description when not present

* feat: mcp on UI and integrated with list tools

* feat: Update mcp server endpoint

* tests: Unit and integration tests for mcp management endpoints

* fix: docs and ensuring global_mcp_manage up to date

* ui: remove the mcp tools view

* fix: ruff lint

* fix: unit -> integration test area

* fix(ui): remove left nav menu of previous tools

---------

Co-authored-by: wagnerjt <wagnerjt@github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* fix: sync DB MCP tools with in memory

* fix: sync DB MCP tools with in memory

* fix: stop using prisma.models

* fix: code qa check

* fix: import MCP

* fix: code QA checks

* fix: code QA checks

* fixes - only list tools for the specific MCP server

* fix: only list MCP tools for selected server

* fix linting error

---------

Co-authored-by: Tyler Wagner <wagnerjt@users.noreply.github.com>
Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-05-28 16:29:27 -07:00
Krrish Dholakia d8415f0c39 bump: version 1.71.1 → 1.71.2 v1.71.2-nightly 2025-05-28 11:34:16 -07:00
Krrish Dholakia cc780ecf5a fix(vertex_llm_base.py): handle default vertex location 2025-05-28 11:33:39 -07:00