Commit Graph

5228 Commits

Author SHA1 Message Date
Ishaan Jaff d2a40c8456 [Fix] - Reliability fix OOMs with image url handling (#19257)
* fix MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_exceeds_size_limit_with_content_length

* fix: _process_image_response

* add constants 50MB

* fix convert_to_anthropic_image_obj image handling

* test_gemini_image_size_limit_exceeded

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB fix

* MAX_IMAGE_URL_DOWNLOAD_SIZE_MB

* test_image_size_limit_disabled

* async_convert_url_to_base64

* docs fix

* code QA check

* fix Exception
2026-01-16 16:41:44 -08:00
mubashir1osmani bcc23a32b8 docs: add redis initalization with kwargs
docs: add redis initalization with kwargs
2026-01-16 18:11:07 -05:00
YutaSaito 66d67ae356 Revert "Add sanititzation for anthropic messages" 2026-01-17 06:01:12 +09:00
Sameer Kankute 5782832b82 Merge pull request #19199 from BerriAI/litellm_fix_stability_issues1
[Fix] Bedrock stability model usage issues
2026-01-16 18:17:11 +05:30
Sameer Kankute fb3b4e6b33 Merge pull request #19196 from BerriAI/litellm_sanitise_anthropic_mesages
Add sanititzation for anthropic messages
2026-01-16 17:48:55 +05:30
Sameer Kankute c66ad4408b Merge pull request #19215 from BerriAI/main
merge main in stability issue
2026-01-16 17:07:57 +05:30
Sameer Kankute 101230e538 Merge pull request #19213 from BerriAI/main
merge main in sanitisation
2026-01-16 17:04:01 +05:30
Sameer Kankute e54af42774 Merge pull request #19211 from BerriAI/main
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer Kankute b0c6a1b308 Merge pull request #19203 from BerriAI/main
merge main
2026-01-16 15:16:29 +05:30
Sameer Kankute 3df0d45d58 fix documentation 2026-01-16 14:47:08 +05:30
Sameer Kankute 8be3712e82 Add docs for message sanitisation 2026-01-16 12:52:13 +05:30
Sameer Kankute d585b760c9 Add fallback endpoints support 2026-01-16 10:51:33 +05:30
mubashir1osmani cbeaca071f docs: add redis initalization with kwargs 2026-01-15 23:15:54 -05:00
Guilherme Segantini 282a28db8b Improve documentation for routing LLM calls via SAP Gen AI Hub (#19166)
* fix(sap): resolve JSON serialization error and update documentation

- Fix 'Object of type cached_property is not JSON serializable' error
- Replace @cached_property with manual caching in deployment_url
- Update documentation examples to match sap_proxy_config.yaml
- Add Anthropic model naming clarification (anthropic-- prefix)
- Improve authentication documentation with tabbed interface

Fixes critical bug preventing SAP Gen AI Hub integration from working.
Fully tested with both chat and embedding endpoints.

* docs: update SAP provider documentation

* Update SAP provider documentation with better setup instructions

Rewrote the SAP docs to make it easier for users to get started. Added a quick start section, clarified the authentication options, explained model naming differences between SDK and proxy usage, and included some troubleshooting tips.

* Revert transformation files - keep only documentation changes
2026-01-15 18:36:11 -08:00
Ishaan Jaff b5b9c39beb [Docs Guide] Litellm claude code end user tracking (#19176)
* add to sidebar

* v1 guide

* guide claude granular cost tracking

* docs fix
2026-01-15 18:32:58 -08:00
Ishaan Jaff 117c7dd158 [Feat] Claude Code - Add End-user tracking with Claude Code (#19171)
* add claude code customer usage tracking

* fix get end user trackign claude code

* TestGetCustomerIdFromStandardHeaders
2026-01-15 17:57:10 -08:00
YutaSaito 960bdbbd8e Revert "[Feat] Add support for 0 cost models" 2026-01-16 09:33:38 +09:00
Krish Dholakia 664ee27ef5 Litellm dev 01 15 2026 p1 (#19153)
* fix: safely handle unmapped call type

* docs: cleanup links for ai coding tools

* docs(claude_non_anthropic_models.md): add tutorial showing non anthropic model connection to claude code

* docs: link to non-anthropic model tutorial for claude code
2026-01-16 00:48:41 +05:30
Vikash c619569604 Added ability to customize logfire base url through env var (#19148)
* Added ability to customize logfire base url through env var

* Added test to check if env var is used correctly for logfire

* Document the env var

* Documented env var in config_settings.md
2026-01-16 00:10:59 +05:30
Krrish Dholakia c7ca2dd4d8 docs(claude_mcp.md): separate claude mcp tutorial into a separate doc
easier to surface
2026-01-15 20:52:31 +05:30
Harshit Jain 8804c78cf9 docs(logging.md): add guide for mounting custom callbacks in Helm/K8s (#19136) 2026-01-15 15:58:44 +05:30
Sameer Kankute 83cdfd886a Merge pull request #19059 from BerriAI/litellm_openrouter_image_gen
Add openrouter support for image/generation endpoints
2026-01-15 15:48:00 +05:30
YutaSaito e3e6fc2806 Merge pull request #19122 from BerriAI/litellm_docs_mcp_troubleshooting
[doc] add MCP troubleshooting guide
2026-01-15 09:34:35 +09:00
Alexsander Hamir f442b57848 docs: Add structured issue reporting guides for CPU and memory issues (#19117) 2026-01-14 15:28:20 -08:00
Yuta Saito 0b04145c11 doc: add MCP troubleshooting guide 2026-01-15 08:01:59 +09:00
Alexsander Hamir 45968c01bd update troubleshoot (#19099) 2026-01-14 10:01:47 -08:00
Alexsander Hamir 0959467699 docs: Update troubleshooting guide with version tracking and error logs/metrics (#19097) 2026-01-14 09:32:28 -08:00
Alexsander Hamir 05ebb0a739 docs: Add troubleshooting guide (#19096) 2026-01-14 09:17:43 -08:00
Harshit Jain e8c4cad885 feat(proxy): cleanup spend logs cron verification, fix, and docs (#19085) 2026-01-14 22:14:48 +05:30
Yuta Saito 16ebfb0d5c docs: add mcp faq 2026-01-14 15:08:31 +09:00
Yuta Saito 2d3c292cd8 chore: Clarify MCP OAuth token handling in UI 2026-01-14 14:31:18 +09:00
Sameer Kankute bc8abf8b4b Add support for openrouter image generation endpoint 2026-01-14 10:15:02 +05:30
Ishaan Jaff 1b00576711 [Feat] New Model - Azure Model Router on LiteLLM AI Gateway (#19054)
* fix - azure model router integration

* fix:_check_provider_match

* fix:_get_response_model

* tests azure model router

* test_azure_ai_model_router_streaming_model_in_chunk

* fix LlmProviders.AZURE.value

* test_azure_ai_model_router_streaming_cost_with_stream_options

* def test_get_model_from_chunks_azure_model_router():

* _get_model_from_chunks

* docs azure model router

* azure model router
2026-01-13 18:31:43 -08:00
Sameer Kankute 1932d03aed Add docs on Zero-Cost Models 2026-01-13 16:44:02 +05:30
Ishaan Jaff a1bba8c99b [Feat] MSFT SSO - allow overriding env var attribute names (#18998)
* add MSFT SSO constants

* fix MSFT SSO env vars

* test_microsoft_sso_handler_openid_from_response_with_custom_attributes
2026-01-12 18:56:35 -08:00
Ishaan Jaff 21d611554b [Fix] MSFT SSO - allow setting custom MSFT Base URLs (#18977)
* fix TestCustomMicrosoftSSO

* init CustomMicrosoftSSO

* use CustomMicrosoftSSO

* docs fix

* docs fix
2026-01-12 18:26:53 -08:00
Ishaan Jaffer f5fc38dcf9 docs litellm cloud 2026-01-12 13:55:56 -08:00
Ishaan Jaffer 5c300b2414 docs fix 2026-01-12 09:50:40 -08:00
Sameer Kankute d3dbe4ffab Add preview to v1.80.15 release note 2026-01-12 22:36:43 +05:30
Sameer Kankute 4cf4d205ba Add preview to v1.80.15 release note 2026-01-12 22:14:14 +05:30
Sameer Kankute 9a27a52424 Merge pull request #18956 from BerriAI/litellm_staging_01_12_2026
Litellm staging 01 12 2026
2026-01-12 18:27:57 +05:30
Cesar Garcia c81cd081e9 feat(bedrock): add OpenAI-compatible service_tier parameter translation (#18091)
* feat(bedrock): add OpenAI-compatible service_tier parameter translation

Translates OpenAI's service_tier parameter (string) to Bedrock's
serviceTier format (object with type field).

* docs(bedrock): add OpenAI-compatible service_tier parameter documentation

Document the automatic translation from OpenAI-style service_tier
parameter to Bedrock's native serviceTier format.

* feat(bedrock): add service_tier to response when present

According to OpenAI's API documentation, when service_tier is sent in the
request, it should be returned in the response. This commit implements
this behavior for Bedrock Converse API to maintain compatibility with
OpenAI's API.

Changes:
- Added serviceTier field to ConverseResponseBlock type definition
- Moved ServiceTierBlock definition before ConverseResponseBlock to fix
  type reference order
- Added response transformation to map Bedrock serviceTier (object) to
  OpenAI service_tier (string format)
- Added 4 new tests for response transformation with service_tier

The service_tier is only added to the response when present in Bedrock's
response, maintaining backward compatibility.
2026-01-12 17:28:49 +05:30
Cesar Garcia 087ddee227 docs: update message content types link and add content types table (#18209)
* docs: update message content types link and add content types table

- Update "See All Message Values" link to point to main branch (line 664)
  instead of outdated commit 8600ec7 (line 392)
- Add Content Types table documenting all 6 multimodal content types:
  text, image_url, input_audio, video_url, file, document
- Link to existing docs for vision, audio, and document understanding

* docs: add type definition links for text and video_url

* docs: fix text type definition link to line 598

* docs: remove provider labels from file/document types

* docs: add examples for all content types per review feedback
2026-01-12 17:09:23 +05:30
Harshit Jain 3257cc7129 doc: updated pass_through with guided param (#18886) 2026-01-12 16:56:16 +05:30
Harshit Jain 45ac107bee doc: update load balancing and routing with enable_pre_call_checks (#18888) 2026-01-12 16:47:25 +05:30
Harshit Jain f9430d1cab docs: add Redis requirement warning for high-traffic deployments (#18892) 2026-01-12 16:46:52 +05:30
Ishaan Jaffer f768b698a9 docs fix 2026-01-11 11:57:23 -08:00
Ishaan Jaffer 1271044b06 1.80.15 2026-01-11 11:57:04 -08:00
Alexsander Hamir 624c9420b9 perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang 039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00