Commit Graph
23504 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub d5ee93aa0c [Feat] Add Recraft API - Image Edits Support (#12874)
* test_recraft_image_edit_api

* add RecraftImageEditConfig

* complete RecraftImageEditConfig

* add RecraftImageEditRequestParams in types

* update RecraftImageEditRequestParams

* working

* transform_image_edit_request

* Image Edit docs recraft

* working transform_image_edit_request

* TestRecraftImageEditTransformation
2025-07-22 15:03:08 -07:00
Ishaan Jaff 31e9303232 remove old test 2025-07-22 14:11:43 -07:00
Jugal D. BhattandGitHub aa1ebf37b2 pass in cmd args (#12871) 2025-07-22 14:10:23 -07:00
Ishaan JaffandGitHub 934af0e9a0 add azure-keyvault==4.2.0 (#12873) 2025-07-22 14:08:33 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
d4900d7dc0 build(deps): bump form-data from 4.0.3 to 4.0.4 in /docs/my-website (#12867)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-22 11:23:41 -07:00
Ishaan Jaff 6f0c211788 [Feat] MCP Gateway - allow using MCPs with all LLM APIs when using /responses with LiteLLM (#12546)
* add MCPResponsesAPIHelper

* rename LiteLLM_Proxy_MCP_Handler

* aresponses_api_with_mcp

* mock_responses_api_response

* test response with litellm proxy MCP

* add _should_use_litellm_mcp_gateway

* fix transform_mcp_tool_to_openai_responses_api_tool

* use correct _transform_mcp_tools_to_openai

* fix config.yaml

* fixes for native MCP handling

* docs MCP with litellm proxy

* aresponses_api_with_mcp

* fix linting

* fix mypy

* fix linting

* test_aresponses_api_with_mcp_mock_integration

* docs How it works when server_url="litellm_proxy"
2025-07-22 10:22:45 -07:00
Krrish Dholakia e683a41993 bump: version 1.74.7 → 1.74.8 2025-07-22 08:54:03 -07:00
Mateo Di LoretoandGitHub c65392cf81 Replace non-root Dockerfile base with Alpine multi-stage build; (#12707)
* Change Dockerfile.noon_root with alpine base image

* Improve non_root docker image

* Re add the build_admin_ui.sh script step

* Re add the build_admin_ui.sh script step

* Remove unnecessary workdir set

* Remove unnecessary workdir set

* Configure chainguard image

* A bit of optimization and improve comments

* delete extra build_ui script run

* Optimizie Dockerfile copy statements
2025-07-22 08:53:10 -07:00
Krrish Dholakia 964c3b7a3d docs(index.md): cleanup 2025-07-22 08:47:52 -07:00
Krrish Dholakia b4469dafd4 docs(index.md): cleanup 2025-07-22 08:47:26 -07:00
Krrish Dholakia 581e96a768 docs(index.md): cleanup 2025-07-22 08:43:33 -07:00
tanjiroandGitHub 03e420f91a Improvements on the Regenerate Key Flow (#12788)
* improve regeneration ux

* toLocaleString

* regenerate key twice in a row

* fix delete key
2025-07-22 07:47:26 -07:00
Ishaan Jaff 03baf23ad1 [Feat] Add Recraft Image Generation API Support - New LLM Provider (#12832)
* add recraft

* init RecraftImageGenerationConfig

* add get_complete_url + validate_environment

* add image_generation_handler in llm http clas

* fixes for transform

* working recraft request

* fixed img gen transform

* fixes for llm http handler

* test: TestRecraftImageGeneration

* fixes for llm_http_handler

* fix RecraftImageGenerationConfig

* TestRecraftImageGenerationTransformation

* add recraft API

* docs recraft API

* fix code QA

* map_openai_params

* fix recraft

* cost tracking for recraft/recraftv3

* fix code qa check
2025-07-21 22:19:58 -07:00
Krish DholakiaandGitHub e5251e7188 Openrouter - filter out cache_control flag for non-anthropic models (allows usage with claude code) (#12850)
* fix(gpt_transformation.py): remove 'cache_control' flag for openai/openai-compatible calls

Fixes https://github.com/BerriAI/litellm/issues/12787

* fix(openrouter/chat/transformation.py): allow passing openrouter cache control flag for claude models

* fix(gpt_transformation.py): fix import

* fix: fix adding tools
2025-07-21 22:15:48 -07:00
Krish DholakiaandGitHub e4e10aa4ed Litellm dev 07 21 2025 p1 (#12848)
* fix(main.py): fix async retryer

Fixes https://github.com/BerriAI/litellm/issues/12830

* fix(forward_clientside_headers_by_model_group.py): filter out 'content-type' from forwardable headers

clientside content-type != proxy content type, can cause requests to hang

* test(tests/): update tests
2025-07-21 22:09:39 -07:00
Krish DholakiaandGitHub db498c1805 Fix team_member_budget update logic (#12843)
* fix(team_endpoints.py): always remove team member budget from updated_kv

this is not a field for the litellm team table

Prevents startup issue

* test(test_team_endpoints.py): add unit test to ensure 'team_member_budget' is never in update to table - separate logic

* refactor: cleanup
2025-07-21 22:06:29 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2be16eb493 build(deps): bump form-data from 4.0.0 to 4.0.4 in /ui/litellm-dashboard (#12851)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-21 22:05:38 -07:00
Krish DholakiaandGitHub 70ffdcd210 Passthrough Auth - make Auth checks OSS + Anthropic - only show 'reasoning_effort' for supported models (#12847)
* fix(anthropic/chat/transformation.py): move 'reasoning_effort' to inside 'supports_reasoning' check

Fixes https://github.com/BerriAI/litellm/issues/12833

* fix(proxy_settings_endpoints.py): change order of checks - don't add allowed ip unless db is connected

Fixes https://github.com/BerriAI/litellm/issues/12815

* feat(user_api_key_auth.py): make passthrough auth checks OSS

Fixes https://github.com/BerriAI/litellm/issues/12789

* docs(enterprise.md): clarify on docs
2025-07-21 21:55:41 -07:00
Ishaan Jaff 49d40a1c3d test_router_provider_wildcard_routing 2025-07-21 21:33:40 -07:00
Krrish Dholakia 68a5415a51 docs(config_settings.md): document new flags 2025-07-21 20:19:26 -07:00
Krish DholakiaandGitHub 00677afefe Litellm batch cost tracking debug (#12782)
* feat(proxy_server.py): support batch polling interval

allows admin to control batch polling interval (default is 3600s)

easier debugging

* fix(proxy_settings_endpoint.py): ensure value is actually set before updating env var
2025-07-21 20:17:56 -07:00
Cole McIntoshandGitHub ff22aed1ea Merge pull request #12826 from colesmcintosh/feature/add-hyperbolic-provider 2025-07-21 20:10:45 -06:00
Tomáš DvořákandGitHub 270e3d75db fix(watsonx): use correct parameter name for tool choice (#9980)
Closes BerriAI/litellm#9979
2025-07-21 19:01:10 -07:00
Ishaan Jaff c91712e579 bump: version 1.74.7 → 1.74.8 2025-07-21 18:29:34 -07:00
Ishaan Jaff 83463e3ea5 fix docusaurus package lock 2025-07-21 18:29:17 -07:00
Ishaan Jaff 443e26f46d fix openrouter/qwen/qwen-vl-plus 2025-07-21 18:25:25 -07:00
Ishaan Jaff 4a7b9dee5f test fix - anthropic deprecated claude 2 2025-07-21 18:22:39 -07:00
Ishaan JaffandGitHub 4ca3e8e617 Docs - litellm benchmarks (#12842)
* docs litellm overhead

* In these tests the baseline latency characteristics
2025-07-21 18:10:30 -07:00
Ishaan JaffandGitHub 133c26c015 [Azure OpenAI Feature] - Support DefaultAzureCredential without hard-coded environment variables (#12841)
* DefaultAzureCredential

* update get_azure_ad_token_provider

* fixes for get_azure_ad_token_provider

* test_get_azure_ad_token_provider_with_default_azure_credential

* test_get_azure_ad_token_fallback_to_default_azure_credential

* docs DefaultAzureCredential

* fix linting
2025-07-21 18:04:16 -07:00
Jugal D. BhattandGitHub 7bdb5593bf [LLM Translation] add qwen-vl-plus (#12829)
* add qwen-vl-plus

* add qwen-vl-plus
2025-07-21 16:58:59 -07:00
Cole McIntosh 34ccda10ed Merge upstream/main - resolve conflicts to include both hyperbolic and recraft providers 2025-07-21 17:38:17 -06:00
Ishaan JaffandGitHub 27c9be67ba [Feat] Add fireworks - fireworks/models/kimi-k2-instruct (#12837)
* add fireworks - fireworks/models/kimi-k2-instruct

* update source
2025-07-21 16:28:02 -07:00
Ishaan Jaff 1b05ea79ce update docs 2025-07-21 15:52:54 -07:00
Ishaan JaffandGitHub 9022d144a6 [Bug Fix] - gemini leaking FD for sync calls with litellm.completion (#12824)
* bug fix - gemini leaking FD for sync calls

* fixes for leaking FD
2025-07-21 15:01:43 -07:00
Ishaan JaffandGitHub 2941a555a8 [Feat] Add Recraft Image Generation API Support - New LLM Provider (#12832)
* add recraft

* init RecraftImageGenerationConfig

* add get_complete_url + validate_environment

* add image_generation_handler in llm http clas

* fixes for transform

* working recraft request

* fixed img gen transform

* fixes for llm http handler

* test: TestRecraftImageGeneration

* fixes for llm_http_handler

* fix RecraftImageGenerationConfig

* TestRecraftImageGenerationTransformation

* add recraft API

* docs recraft API

* fix code QA

* map_openai_params

* fix recraft

* cost tracking for recraft/recraftv3

* fix code qa check
2025-07-21 15:01:32 -07:00
Cole McIntoshandGitHub 774af8085e docs: add Google Cloud Model Armor guardrail documentation (#12814)
- Add comprehensive documentation for Model Armor integration
- Include configuration examples and parameter descriptions
- Add Model Armor to sidebars navigation
- Document authentication methods and error handling
2025-07-21 14:24:44 -07:00
Adam HolmbergandGitHub 6a1b232330 fix: remove deprecated groq/qwen-qwq-32b and add qwen/qwen3-32b (#12831)
fixes #12825
2025-07-21 14:21:21 -07:00
Cole McIntoshandGitHub c5b51cd2b4 feat: add Morph provider support (#12821)
* feat: add Morph provider support

- Add MorphChatConfig implementation for OpenAI-compatible API
- Support morph-v3-fast and morph-v3-large models
- Add pricing: morph-v3-fast (/bin/zsh.8/.2 per 1M tokens), morph-v3-large (/bin/zsh.9/.9 per 1M tokens)
- Both models support 16k context window and system messages
- Add comprehensive documentation and unit tests
- Update all necessary integration points (constants, init, provider logic)

* feat: Add Morph provider support in ProviderConfigManager

- Extend ProviderConfigManager to include MorphChatConfig for the Morph LLM provider.
- Update MorphChatConfig by removing unused parameters from the configuration.
2025-07-21 13:52:45 -07:00
Cole McIntosh c1d5e275bc feat: register Hyperbolic provider in ProviderConfigManager
- Added support for Hyperbolic provider in the ProviderConfigManager.
- Integrated HyperbolicChatConfig to handle configurations for the new provider.
2025-07-21 14:51:49 -06:00
Cole McIntoshandGitHub 6059b5c1f6 Merge branch 'BerriAI:main' into feature/add-hyperbolic-provider 2025-07-21 14:43:30 -06:00
Jugal D. BhattandGitHub b653aed603 added dynamic endpoint support (#12827) 2025-07-21 12:38:53 -07:00
Cole McIntosh 6040c329a4 feat: add Hyperbolic provider support
- Add Hyperbolic as a new OpenAI-compatible provider
- Implement HyperbolicChatConfig inheriting from OpenAILikeChatConfig
- Register Hyperbolic in provider lists and constants
- Add comprehensive model configurations with pricing for:
  - DeepSeek models (V3, R1, etc.)
  - Qwen models (2.5, 3, QwQ, etc.)
  - Meta Llama models (3.1, 3.2, 3.3)
  - Other models like Kimi K2, Hermes 3, etc.
- Configure default API base URL: https://api.hyperbolic.xyz/v1
- Add provider documentation with usage examples
- Create unit tests for provider functionality
- Support all standard OpenAI parameters

Hyperbolic provides low-cost inference with OpenAI-compatible APIs,
supporting latest models without infrastructure overhead.
2025-07-21 13:18:50 -06:00
Ishaan JaffandGitHub 0ae83d6594 [Docs] Show correct list of vertex ai mistral models (#12828)
* docs update - mistral-large-2411

* docs VertexAI Mistral API

* docs vertex mistral
2025-07-21 12:04:04 -07:00
Ishaan JaffandGitHub 67edd7c481 fix team edit guardrail (#12823) 2025-07-21 11:44:22 -07:00
Cole McIntoshandGitHub 41436fefa0 feat: Add Lambda AI provider support (#12817)
* feat: add Lambda AI provider support

Add support for Lambda AI (lambda.ai) as a new LLM provider in LiteLLM. Lambda AI provides access to a wide range of open-source models through their cloud GPU infrastructure.

Changes:
- Add Lambda AI provider implementation (OpenAI-compatible)
- Register 20 Lambda AI models with accurate pricing and 131k context windows
- Add comprehensive tests for Lambda AI integration
- Add detailed documentation with usage examples
- Use "lambda_ai" as provider name to avoid Python keyword conflict

Models include Llama 3.x, DeepSeek, Hermes, Qwen, and specialized models for coding and vision tasks.

* fix(tests): ensure lambda_ai_models list is repopulated after model cost reload

Updated test cases to clear and repopulate the lambda_ai_models list after reloading the model cost map. This ensures that the tests accurately reflect the current state of available models.

* feat: add Lambda AI chat configuration support

Added support for Lambda AI chat configuration in the ProviderConfigManager. This enhancement allows the integration of Lambda AI as a provider, expanding the capabilities of LiteLLM.
2025-07-21 10:23:10 -07:00
Pavan GudiwadaandGitHub 1faedd599f Adding HolmesGPT to projects using LiteLLM (#12798) 2025-07-21 09:24:09 -07:00
Lv ZehuiandGitHub db80b98141 docs(moonshot): correct base url and document CN-specific endpoint (#12804) 2025-07-21 09:23:48 -07:00
tanjiroandGitHub a752d7acc9 Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703) 2025-07-20 20:24:38 -07:00
Krrish Dholakia c946ae8550 docs(bulk_edit_users.md): add guide on bulk editing existing users 2025-07-19 18:26:09 -07:00
Ishaan Jaff 3062a2fead docs fixes 2025-07-19 18:04:38 -07:00