Commit Graph
23533 Commits
Author SHA1 Message Date
Ishaan Jaff 0d2e280e78 ci/cd new release 2025-07-23 09:04:26 -07:00
Ishaan Jaff 00fd020291 fix test 2025-07-23 09:04:09 -07:00
Krrish Dholakia 4277becdc2 docs(credentials.tsx): cleanup reference to dead link 2025-07-23 09:02:39 -07:00
Ishaan Jaff 60ed272ae0 ci/cd litellm 2025-07-23 07:15:33 -07:00
Ishaan Jaff 5616aaee6d docs pillar guard 2025-07-23 07:15:02 -07:00
Ishaan Jaff 477ca5c0f6 test_proxy_all_models 2025-07-23 07:11:35 -07:00
Krrish Dholakia 663dea37a8 docs: fix docs 2025-07-22 23:30:50 -07:00
Igal BoxermanandGitHub d118cc7098 feat: Add Pillar Security guardrail integration (#12791)
* feat: Add Pillar Security guardrail integration

Implements comprehensive LLM security guardrails using Pillar Security API with support for prompt injection detection, PII/secret detection, content moderation, and multi-mode execution (pre_call, during_call, post_call). Includes complete documentation, testing, and configurable actions on flagged content.

* fix: Resolve MyPy type error in Pillar guardrail config

Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.

* fix: Resolve MyPy type error in Pillar guardrail config

Restructure PillarGuardrailConfigModel to properly inherit from GuardrailConfigModel[T]
and resolve return type compatibility issue in get_config_model method.

* fix docs

* fix docs

* improved docs

* fix examples, READY
2025-07-22 23:17:33 -07:00
Murad KhafizovandGitHub a6ddf5c744 feat: extended /v1/models endpoint, now it returns with fallbacks on demand (#12811)
* Extended `/v1/model` endpoint to support fallbacks

* unit tests reworked

* linting fixes

* fix lining error

* fix linting
2025-07-22 23:16:46 -07:00
Stuart GeigerandGitHub 37c626a9a0 rm retired anthropic models from model_prices_and_context_window.json (#12864)
rm claude-2, claude-2.1, claude-3-sonnet-20240229
2025-07-22 23:14:37 -07:00
Jugal D. BhattandGitHub 03d5102044 [Add health check] add architecture diagram (#12879)
* add architecture diagram

* add image path

* add new image
2025-07-22 23:12:19 -07:00
Jugal D. BhattandGitHub 405eb7f243 [Docs ]Litellm mcp access group doc (#12883)
* add example for config

* fix typo
2025-07-22 23:11:53 -07:00
Krish DholakiaandGitHub d26f74ade5 Request Headers - support x-litellm-num-retries + Usage - support usage by model group (#12890)
* feat(litellm_pre_call_utils.py): add num_retries to litellm data for backend call

allow user to pass in num retries via request headers

* test(test_litellm_pre_call_utils.py): add unit test

* docs(request_headers.md): document new request header

* fix(common_daily_activity.py): show spend breakdown by model group

Partial fix for https://github.com/BerriAI/litellm/issues/12887

* feat(new_usage.tsx): new tab switcher for viewing usage by model group vs. received model

Closes https://github.com/BerriAI/litellm/issues/12887
2025-07-22 23:09:36 -07:00
Ishaan Jaff a0846c3f31 ci/cd new release 2025-07-22 21:08:02 -07:00
Ishaan Jaff 642cfa26b0 remove deprecated 2025-07-22 20:59:34 -07:00
Ishaan Jaff 3a76b2762f ci/cd new release 2025-07-22 20:41:49 -07:00
Ishaan Jaff 5741cdae0f fix openrouter/qwen/qwen-vl-plus 2025-07-22 20:37:57 -07:00
Krish DholakiaandGitHub 8cd6c25e1e Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) (#12886)
* fix(main.py): fix async retryer

Fixes https://github.com/BerriAI/litellm/issues/12830

* fix(forward_clientside_headers_by_model_group.py): filter out 'content-type' from forwardable headers

clientside content-type != proxy content type, can cause requests to hang
2025-07-22 19:50:05 -07:00
Ishaan JaffandGitHub b41ce5c92f [Feat] - Track cost + add tags for health checks done by LiteLLM Proxy (#12880)
* refactor to use add_user_api_key_auth_to_request_metadata

* add get_litellm_internal_health_check_user_api_key_auth

* add get_litellm_internal_health_check_user_api_key_auth

* add _update_model_params_with_health_check_tracking_information

* add HealthCheckHelpers

* refactor to use clean helpers

* test_update_model_params_with_health_check_tracking_information

* test_get_litellm_internal_health_check_user_api_key_auth

* test_add_user_api_key_auth_to_request_metadata

* fix _update_model_params_with_health_check_tracking_information
2025-07-22 18:45:57 -07:00
Ishaan Jaff c21dc46a33 fix morph api tests 2025-07-22 18:44:44 -07:00
Ishaan Jaff bd8b21e700 fix mypy linting 2025-07-22 18:38:54 -07:00
Ishaan Jaff d93e85282e test_bad_database_url 2025-07-22 18:37:51 -07:00
Ishaan Jaff bf300f8ca7 Revert "Litellm dev 07 21 2025 p1 (#12848)"
This reverts commit e4e10aa4ed.
2025-07-22 18:28:36 -07:00
Ishaan Jaff f0a8abb911 fix cost_calculator 2025-07-22 18:16:53 -07:00
Ishaan Jaff 4b741adadb fix recraft cost calc 2025-07-22 18:12:12 -07:00
Ishaan Jaff e5debfc84c fix model cost map for recraft 2025-07-22 18:11:10 -07:00
Ishaan Jaff 1910cf8496 test fix vertex ai 2025-07-22 18:06:38 -07:00
Ishaan JaffandGitHub b026f6b280 [Feat] Add cost tracking for new vertex_ai/llama-3 API models (#12878)
* add vertex_ai/meta/llama-3.1-405b-instruct-maas

* notes - vertex_ai/meta/llama-3.2-90b-vision-instruct-maas
2025-07-22 16:22:09 -07:00
c9899b5c06 [LLM Translation] Litellm gemini 2.0 live support (#12839)
* add gemini 2.0 live to model context and priceS

* added files to dump

* Update litellm/model_prices_and_context_window_backup.json

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update model_prices_and_context_window.json

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* added vertex ai live preview

* added vertex ai change

* add input video and image cosT

* add input video and image cosT

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-22 15:14:52 -07:00
Ishaan JaffandGitHub d5ee93aa0c [Feat] Add Recraft API - Image Edits Support (#12874)
* test_recraft_image_edit_api

* add RecraftImageEditConfig

* complete RecraftImageEditConfig

* add RecraftImageEditRequestParams in types

* update RecraftImageEditRequestParams

* working

* transform_image_edit_request

* Image Edit docs recraft

* working transform_image_edit_request

* TestRecraftImageEditTransformation
2025-07-22 15:03:08 -07:00
Ishaan Jaff 31e9303232 remove old test 2025-07-22 14:11:43 -07:00
Jugal D. BhattandGitHub aa1ebf37b2 pass in cmd args (#12871) 2025-07-22 14:10:23 -07:00
Ishaan JaffandGitHub 934af0e9a0 add azure-keyvault==4.2.0 (#12873) 2025-07-22 14:08:33 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
d4900d7dc0 build(deps): bump form-data from 4.0.3 to 4.0.4 in /docs/my-website (#12867)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-22 11:23:41 -07:00
Ishaan Jaff 6f0c211788 [Feat] MCP Gateway - allow using MCPs with all LLM APIs when using /responses with LiteLLM (#12546)
* add MCPResponsesAPIHelper

* rename LiteLLM_Proxy_MCP_Handler

* aresponses_api_with_mcp

* mock_responses_api_response

* test response with litellm proxy MCP

* add _should_use_litellm_mcp_gateway

* fix transform_mcp_tool_to_openai_responses_api_tool

* use correct _transform_mcp_tools_to_openai

* fix config.yaml

* fixes for native MCP handling

* docs MCP with litellm proxy

* aresponses_api_with_mcp

* fix linting

* fix mypy

* fix linting

* test_aresponses_api_with_mcp_mock_integration

* docs How it works when server_url="litellm_proxy"
2025-07-22 10:22:45 -07:00
Krrish Dholakia e683a41993 bump: version 1.74.7 → 1.74.8 2025-07-22 08:54:03 -07:00
Mateo Di LoretoandGitHub c65392cf81 Replace non-root Dockerfile base with Alpine multi-stage build; (#12707)
* Change Dockerfile.noon_root with alpine base image

* Improve non_root docker image

* Re add the build_admin_ui.sh script step

* Re add the build_admin_ui.sh script step

* Remove unnecessary workdir set

* Remove unnecessary workdir set

* Configure chainguard image

* A bit of optimization and improve comments

* delete extra build_ui script run

* Optimizie Dockerfile copy statements
2025-07-22 08:53:10 -07:00
Krrish Dholakia 964c3b7a3d docs(index.md): cleanup 2025-07-22 08:47:52 -07:00
Krrish Dholakia b4469dafd4 docs(index.md): cleanup 2025-07-22 08:47:26 -07:00
Krrish Dholakia 581e96a768 docs(index.md): cleanup 2025-07-22 08:43:33 -07:00
tanjiroandGitHub 03e420f91a Improvements on the Regenerate Key Flow (#12788)
* improve regeneration ux

* toLocaleString

* regenerate key twice in a row

* fix delete key
2025-07-22 07:47:26 -07:00
Ishaan Jaff 03baf23ad1 [Feat] Add Recraft Image Generation API Support - New LLM Provider (#12832)
* add recraft

* init RecraftImageGenerationConfig

* add get_complete_url + validate_environment

* add image_generation_handler in llm http clas

* fixes for transform

* working recraft request

* fixed img gen transform

* fixes for llm http handler

* test: TestRecraftImageGeneration

* fixes for llm_http_handler

* fix RecraftImageGenerationConfig

* TestRecraftImageGenerationTransformation

* add recraft API

* docs recraft API

* fix code QA

* map_openai_params

* fix recraft

* cost tracking for recraft/recraftv3

* fix code qa check
2025-07-21 22:19:58 -07:00
Krish DholakiaandGitHub e5251e7188 Openrouter - filter out cache_control flag for non-anthropic models (allows usage with claude code) (#12850)
* fix(gpt_transformation.py): remove 'cache_control' flag for openai/openai-compatible calls

Fixes https://github.com/BerriAI/litellm/issues/12787

* fix(openrouter/chat/transformation.py): allow passing openrouter cache control flag for claude models

* fix(gpt_transformation.py): fix import

* fix: fix adding tools
2025-07-21 22:15:48 -07:00
Krish DholakiaandGitHub e4e10aa4ed Litellm dev 07 21 2025 p1 (#12848)
* fix(main.py): fix async retryer

Fixes https://github.com/BerriAI/litellm/issues/12830

* fix(forward_clientside_headers_by_model_group.py): filter out 'content-type' from forwardable headers

clientside content-type != proxy content type, can cause requests to hang

* test(tests/): update tests
2025-07-21 22:09:39 -07:00
Krish DholakiaandGitHub db498c1805 Fix team_member_budget update logic (#12843)
* fix(team_endpoints.py): always remove team member budget from updated_kv

this is not a field for the litellm team table

Prevents startup issue

* test(test_team_endpoints.py): add unit test to ensure 'team_member_budget' is never in update to table - separate logic

* refactor: cleanup
2025-07-21 22:06:29 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2be16eb493 build(deps): bump form-data from 4.0.0 to 4.0.4 in /ui/litellm-dashboard (#12851)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-21 22:05:38 -07:00
Krish DholakiaandGitHub 70ffdcd210 Passthrough Auth - make Auth checks OSS + Anthropic - only show 'reasoning_effort' for supported models (#12847)
* fix(anthropic/chat/transformation.py): move 'reasoning_effort' to inside 'supports_reasoning' check

Fixes https://github.com/BerriAI/litellm/issues/12833

* fix(proxy_settings_endpoints.py): change order of checks - don't add allowed ip unless db is connected

Fixes https://github.com/BerriAI/litellm/issues/12815

* feat(user_api_key_auth.py): make passthrough auth checks OSS

Fixes https://github.com/BerriAI/litellm/issues/12789

* docs(enterprise.md): clarify on docs
2025-07-21 21:55:41 -07:00
Ishaan Jaff 49d40a1c3d test_router_provider_wildcard_routing 2025-07-21 21:33:40 -07:00
Krrish Dholakia 68a5415a51 docs(config_settings.md): document new flags 2025-07-21 20:19:26 -07:00
Krish DholakiaandGitHub 00677afefe Litellm batch cost tracking debug (#12782)
* feat(proxy_server.py): support batch polling interval

allows admin to control batch polling interval (default is 3600s)

easier debugging

* fix(proxy_settings_endpoint.py): ensure value is actually set before updating env var
2025-07-21 20:17:56 -07:00