f487f4e3a9
feat: add dynamic OAuth2 metadata discovery for MCP servers ( #16676 )
...
* feat: add dynamic OAuth2 metadata discovery for MCP servers
* fix: lint error
2025-11-14 18:14:43 -08:00
7faff1a7c0
pkg lock
2025-11-14 17:43:43 -08:00
936bed056b
security fix
2025-11-14 17:43:00 -08:00
8a43fbe8f7
Revert "[Feat] VertexAI - Add BGE Embeddings support ( #16033 )" ( #16677 )
...
This reverts commit 7133488282
2025-11-14 17:41:06 -08:00
bffc36794f
docs fix spend tracking ( #16675 )
2025-11-14 17:22:21 -08:00
efa4ec9294
[Docs] Add docs on APIs for model access management ( #16673 )
...
* docs access groups
* docs ui for access groups
* fix code snippets
* docs model access
2025-11-14 17:07:54 -08:00
2bd6d0d82b
[Feat] Bedrock Batches - Add support for custom KMS encryption keys in Bedrock Batch operations ( #16662 )
...
* add s3_encryption_key_id
* add s3EncryptionKeyId to BedrockS3OutputDataConfig
* use s3EncryptionKeyId in bedrock output
* docs s3_encryption_key_id
* test_bedrock_batch_with_encryption_key_in_post_request
2025-11-14 16:00:43 -08:00
b1922e19f8
Voyageai pricing and doc update ( #16641 )
...
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Updating the available VoyageAI models in the docs
* Updating the available VoyageAI models in the docs
* Updating the model prices and the docs
2025-11-14 14:09:11 -08:00
65061bafc7
feat(openai): Add support for reasoning_effort='none' in GPT-5.1 ( #16658 )
...
* feat(openai): Add support for reasoning_effort='none' in GPT-5.1
OpenAI's GPT-5.1 introduced a new reasoning effort parameter 'none'
which replaces the previous 'minimal' setting for faster, lower-latency
responses. This is now the default setting for GPT-5.1.
Changes:
- Updated REASONING_EFFORT type to include 'none' value
- Added GPT-5.1, GPT-5-mini, and GPT-5-nano to documentation
- Updated docs to reflect 'none' as GPT-5.1's default reasoning effort
- Added test to verify reasoning_effort='none' passes through correctly
Fixes #16633
* feat(responses): Add support for reasoning_effort='none' in Responses API transformation
2025-11-14 13:41:49 -08:00
13993d6ea3
Add fal-ai/flux/schnell support ( #16580 )
2025-11-13 22:31:31 -08:00
266744a5bd
docs: add contribution guide for new guardrails
2025-11-13 22:29:42 -08:00
124ba463f8
[Feat] RunwayML - Add support for /audio/speech eleven_multilingual_v2 endpoint ( #16604 )
...
* init RunwayMLTextToSpeechConfig
* add RunwayMLTextToSpeechConfig
* add RunwayMLTextToSpeechConfig
* test_runwayml_tts_async
* runway ml speech
* fix voices
* fix test
* docs runway lm
* add runwayml here
* fix RunwayMLTextToSpeechConfig
* test_openai_voice_mapping_to_runwayml
2025-11-13 14:32:09 -08:00
911a009869
[Docs] LiteLLM Quick start - show how model resolution works ( #16602 )
...
* docs nderstanding Model Configuration
* docs fix
2025-11-13 13:28:01 -08:00
7133488282
[Feat] VertexAI - Add BGE Embeddings support ( #16033 )
...
* Support for Custom Vertex AI Models via PSC Endpoint with api_base (#15953 )
* Support for Custom Vertex AI Models via PSC Endpoint with api_base
* Add docs related psc
* remove not needed files
* remove print statemnt
* fix mypy errors
* add TextEmbeddingBGEInput
* add VertexBGEConfig
* add BGE handling
* test_vertex_ai_bge_embedding_with_custom_api_base
* fix request transform vertex BGE
* test_vertex_ai_bge_embedding_with_custom_api_base
* tes BGE
* test_is_bge_model_detection
* docs cleanup
* handling BGE URL
* fix VertexBGEConfig
* test_vertex_ai_bge_with_endpoint_id_pattern
* docs vertex BGE
* docs
* docs fix
* fix VertexAIModelRoute
* from ..common_utils import VertexAIError, get_vertex_base_model_name
add
* fix VertexAIGemmaModels
* fix get_vertex_base_model_name
* test_vertex_ai_bge_psc_endpoint_url_construction
---------
Co-authored-by: Sameer Kankute <sameer@berri.ai >
2025-11-13 12:41:00 -08:00
491f57a349
feat: Add support for reasoning_effort="none" for Gemini models ( #16548 )
...
Implements support for reasoning_effort="none" parameter for Gemini models,
providing significant cost savings (up to 96% cheaper) by disabling thinking
budget while maintaining response quality.
Changes:
- Added "supports_reasoning": true to gemini-2.0-flash-thinking-exp-01-21 in model config
- Implemented mapping for reasoning_effort="none" to thinkingConfig {thinkingBudget: 0, includeThoughts: false}
- Added unit test to verify the mapping works correctly
Performance impact:
- Without reasoning_effort: ~313 tokens
- With reasoning_effort="none": ~12 tokens (96% cheaper)
Closes #16420
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
2025-11-12 19:41:07 -08:00
c017f665e0
docs(openai): Document reasoning_effort summary field options ( #16549 )
...
Related to PR #16210 which fixed automatic summary field addition
Changes:
- Document reasoning_effort string vs dict formats
- Add summary field options (auto, detailed, concise)
- Add table of supported reasoning_effort values by GPT-5 model
- Clarify model-specific support and limitations
- Note that summary field requires org verification
The previous implementation automatically added summary field causing
400 errors for unverified orgs. Now users can opt-in by passing
reasoning_effort as dict with explicit summary field.
2025-11-12 19:40:11 -08:00
018bd2e039
Add Gemini image edit support ( #16430 )
...
* Add gemini image edit support
* fix lint errors
* fix lint errors
* fix lint errors
* Add docs
2025-11-12 18:48:27 -08:00
78c169a524
docs fix
2025-11-12 18:30:01 -08:00
394da34a0b
Add all gemini image models support in image generation ( #16526 )
2025-11-12 18:26:44 -08:00
b30439257b
[Feat] Add RunwayML Img Gen API support ( #16557 )
...
* TestRunwaymlImageGeneration
* fix RUNWAYML
* rename
* fix rename
* get_runwayml_image_generation_config
* get_runwayml_image_generation_config
* TestRunwaymlImageGeneration
* add RUNWAYML_POLLING_TIMEOUT
* fix rnwayml transform img gen
* runwayml_image_cost_calculator
* runwayml_image_cost_calculator
* docs runwayml
* fix runwayML polling
* test_get_first_default_fallback
2025-11-12 18:20:14 -08:00
1393900c22
[Docs] Fix code block indentation for fallbacks page ( #16542 )
2025-11-12 18:08:52 -08:00
a05ad46394
feat: add litellm cloud self-serve to docs
2025-11-12 17:13:14 -08:00
ae3178d5d4
docs(deploy.md): document how to disable pulling live model prices (faster startup time) on docker deployment
2025-11-12 13:49:44 -08:00
020a66c01f
docs(model_access_guide.md): explain how model access works on litellm
2025-11-12 13:44:38 -08:00
c6d2714c52
docs(model_access_guide.md): document how model access works on litellm
2025-11-12 13:43:13 -08:00
20350fa094
docs: update broken Slack invite links to support page ( #16546 )
...
Replace broken Slack links (litellmossslack.slack.com and expired invite URLs)
with the correct support page URL (https://www.litellm.ai/support ) across all
documentation files.
Files updated:
- CONTRIBUTING.md
- docs/my-website/docs/contact.md
- docs/my-website/docs/proxy/docker_quick_start.md
- docs/my-website/docs/troubleshoot.md
- docs/my-website/src/pages/contact.md
2025-11-12 12:41:55 -08:00
a1748ad550
Documentation Code Example corrections ( #16502 )
...
* Update quick_start.md
changed -D to -d
* Update users.md
Changed in a number of locations:
"budget_duration": 10s,
to
"budget_duration": "10s",
* Update users.md
Changed all 10s to 30s to keep in line with the example
2025-11-11 19:06:44 -08:00
50b5cf5215
[Feat] New Provider - Add RunwayML Provider for video generations ( #16505 )
...
* add RUNWAYML
* init folders
* add RunwayMLVideoConfig
* add RUNWAYML_DEFAULT_API_VERSION
* add RunwayMLVideoConfig
* fix getting status
* add async_transform_video_content_response
* add runwayml transform_video_content_response
* fix config.yaml
* add runwayml docs
* add runwayml to videos
* docs runwayml video gen
* add new models to model cost map
* TestRunwayMLVideoTransformation
* fix linting errors
2025-11-11 18:48:23 -08:00
663f2d7e7f
docs: remove enterprise restriction from guardrails list endpoint ( #15333 )
...
- Remove enterprise-only label from 'View Available Guardrails' section
- The /guardrails/list endpoint appears to be available in OSS version
- Makes documentation more accurate for OSS users
2025-11-11 18:45:26 -08:00
443bada425
Add Zscaler AI Guard hook ( #15691 )
...
* Add Zscaler AI Guard hook
Co-authored-by: Angela Tao <atao@zscaler.com >
* Fix lint error, update document
* Fix lint error, update document
* update document
* fix mypy type error
* fix mypy issue
* fix test
* fix test
* improve document
* remove unuseful code
* use litellm httphandler
* update test cases
* revover guardrail_initializers.py and guardrail_registry.py
* remove unuse import
* app apply_guardrail
* remove functions repleased by apply_guardrail, update test and doc
* remove functions repleased by apply_guardrail, update test and doc
---------
Co-authored-by: Angela Tao <atao@zscaler.com >
2025-11-11 15:34:27 -08:00
be05324645
docs fix MAX_LANGFUSE_INITIALIZED_CLIENTS
2025-11-11 11:26:33 -08:00
5c9f50d584
[AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users ( #16456 )
...
* add _apply_budget_limits_to_end_user_params
* add _apply_budget_limits_to_end_user_params
* add _apply_budget_limits_to_end_user_params
* test_default_budget_applied_to_end_user_without_budget
* docs fix
* fix config
2025-11-11 08:20:13 -08:00
aaa8cba00b
Add docs for tracking callback failure ( #16474 )
2025-11-10 19:15:14 -08:00
bf363cdf10
Add sdk focused examples ( #16441 )
2025-11-10 18:39:34 -08:00
be3c09e6d5
Add GET list of providers endpoint ( #16432 )
2025-11-10 18:38:09 -08:00
a97676b8ae
Add softgen to projects that are using litellm ( #16423 )
...
* Add Softgen project documentation
* Add Softgen project to sidebars
* Update Softgen
2025-11-10 11:09:29 -08:00
013c195ab7
Fix container api link ( #16440 )
2025-11-10 11:09:10 -08:00
50f35fca47
docs: reorder docs
2025-11-10 07:33:22 -08:00
c088483da9
docs playground
2025-11-08 18:15:52 -08:00
f2832ba2f8
docs fix
2025-11-08 17:25:01 -08:00
b803af4aae
docs fix
2025-11-08 17:05:20 -08:00
36d181e398
docs fix + linting fix
2025-11-08 17:02:00 -08:00
42c1e4740a
docs built in guard
2025-11-08 16:59:00 -08:00
a298a9d492
docs fix
2025-11-08 16:52:26 -08:00
7fb46e0b29
docs fix
2025-11-08 16:50:51 -08:00
4647b41d7f
docs fix
2025-11-08 16:50:06 -08:00
08cfc2bf7e
[Docs] Litellm 1 79 2 rc ( #16415 )
...
* stash - v1
* docs fix
* docs fix
* docs
* folder fix
* docs fix
2025-11-08 16:47:15 -08:00
277b564385
add: performance improvements to release notes ( #16401 )
...
* add: performance improvements to release notes
* fix: mention which endpoint is getting faster
* fix: clarify that reported latency is end-to-end
2025-11-08 16:42:58 -08:00
20180ff93b
[Docs] litellm content filter guard ( #16413 )
...
* add gif 1
* add guard 2
* add guard 3
* guard 5
* docs fix
* docs fix
2025-11-08 16:30:13 -08:00
86d73c918c
Adds support for returning Azure Content Policy error information when exceptions from Azure OpenAI occur ( #16231 )
...
* add provider_specific_fields to ContentPolicyViolationError
* use provider_specific_fields in ProxyException
* update openai_exception_handler
* fix use exception checker for content policy violation azure
* add AzureOpenAIExceptionMapping
* test_azure_with_content_safety_error
* Accessing Provider-Specific Error Details
* TestExceptionCheckers
* unit test got provider_specific_fields=
* add clear types for error dict
* fix test_azure_with_content_safety_error
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
2025-11-08 16:04:36 -08:00
YutaSaito