Krish Dholakia and GitHub
242c06e691
Merge pull request #13784 from mubashir1osmani/docs-deploy
2025-08-23 15:40:34 -07:00
Mubashir Osmani and GitHub
1a8d3cc2d5
Added FAQ under deployment docs ( #13912 )
...
* updated faq questions
* updated faq
* added faq under deployment
2025-08-23 13:22:56 -07:00
Ishaan Jaff and GitHub
9750374081
[Feat] New LLM API - AI/ML API for Image Gen ( #13893 )
...
* add LlmProviders.AIML
* add AIMLChatConfig
* add aiml
* fix AimlImageGenerationConfig
* add AimlImageGenerationConfig
* add cost_calculator
* fixes for AI ML API
* add known AIML Flux image models
* add AIML Cost Calc
* add AI/ML API
* add aiml_models
2025-08-23 13:12:44 -07:00
Krish Dholakia and GitHub
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1
2025-08-23 12:09:53 -07:00
mubashir1osmani
d664860aa1
added openai models to config
2025-08-23 10:02:49 -04:00
Krish Dholakia and GitHub
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
...
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Krish Dholakia and GitHub
28ea6cd35f
Merge pull request #13899 from TeddyAmkie/docs/team-rate-limits-update
...
docs: clarify prerequisites and env var for team rate limits
2025-08-22 23:50:24 -07:00
Ishaan Jaff
f9e9f8c25e
docs AWS_REGION
2025-08-22 17:48:37 -07:00
Ishaan Jaff and GitHub
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py ( #13895 )
...
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
2025-08-22 16:17:57 -07:00
Teddy Amkie
08d1c96ed1
docs: clarify prerequisites and env var for team rate limits
2025-08-22 18:39:31 +00:00
Sameer Kankute and GitHub
694a9f0f4c
[Documentation] Litellm rerank deepinfra endpoint ( #13845 )
...
* Add documentation for deepinfra rerank endpoint
* Add the missed import
* fix supported param
2025-08-22 09:51:42 -07:00
Krish Dholakia and GitHub
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main
...
Update Baseten LiteLLM integration
2025-08-21 18:34:36 -07:00
jinskjoy
d8a33e137d
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-21 20:35:07 +02:00
Krrish Dholakia
5c1b27af99
docs(quick_start.md): add back to navbar
...
useful for showing setup via cli
2025-08-20 15:09:19 -07:00
Krrish Dholakia
fb5b2d8d47
docs: remove old doc
...
prevent showing up on searches
2025-08-20 15:01:32 -07:00
Ishaan Jaff and GitHub
55dcaded72
[Feat] Add VertexAI qwen API Service ( #13828 )
...
* add support for vertex AI QWEN API
* streaming QWEN API support
* test_partner_models_httpx
* test_partner_models_httpx_streaming
* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa
* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
Ishaan Jaff
e229a6a796
security fix
2025-08-20 08:35:59 -07:00
mubashir1osmani
ef9e50458d
removed faq
2025-08-19 17:01:31 -04:00
mubashir1osmani
2edcc51e57
updated claude-code docs and deployment faq
2025-08-19 16:52:46 -04:00
Philip Kiely
7c3d522435
Update Baseten LiteLLM integration
2025-08-19 12:21:05 -07:00
Krish Dholakia and GitHub
422447b7f1
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses
...
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
2025-08-18 18:59:28 -07:00
Krrish Dholakia
0459604721
docs: document new param
2025-08-18 18:56:39 -07:00
Ishaan Jaff and GitHub
ba0881d728
[Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations ( #13735 )
...
* add image edits litellm proxy on SDK
* add image gen provider
* add IMG Gen support for litellm_proxy provider
2025-08-18 18:26:32 -07:00
Ishaan Jaff
eee93e250a
docs v1.75.5-stable
2025-08-18 09:23:18 -07:00
TensorNull and GitHub
159cfe5b4c
Merge branch 'BerriAI:main' into main
2025-08-18 09:46:12 +08:00
Krrish Dholakia
21549a3463
docs(index.md): write up on session management
2025-08-16 17:55:18 -07:00
Krrish Dholakia
cb95f2d5d7
docs(index.md): clarify risk of upgrade
2025-08-16 17:38:50 -07:00
Krrish Dholakia
788a1d03a1
docs(index.md): cleanup
2025-08-16 17:33:07 -07:00
Krrish Dholakia
235b6b040f
docs(index.md): add highlight note on redis latency improvements
2025-08-16 17:32:45 -07:00
Krrish Dholakia
8a75ab8388
docs(index.md): cleanup doc
2025-08-16 17:16:04 -07:00
Ishaan Jaff and GitHub
5889311b10
[Docs] v1.75.8-stable ( #13676 )
...
* v1-75-8
* fix responses API docs
* docs fix
* docs fix new models
* docs links
* docs fix links
* docs sambanova
* docs fix
2025-08-16 09:20:04 -07:00
Krish Dholakia and GitHub
f360e0ead2
Merge pull request #13590 from BerriAI/litellm_bedrock_api_header
...
[LLM translation] Refactor Anthropic Configurations and Add Support for `anthropic_beta` Headers
2025-08-14 11:32:18 -07:00
Ishaan Jaff and GitHub
5bb96af818
[Feat] Add reasoning_effort param for hosted_vllm provider ( #13620 )
...
* add reasoning_effort to hosted_vllm
* test_hosted_vllm_supports_reasoning_effort
* Reasoning Effort
2025-08-14 10:10:30 -07:00
Ishaan Jaff and GitHub
76d25926d4
[Feat] New provider - Azure AI Flux Image Generation ( #13592 )
...
* init files
* add AzureFoundryModelInfo
* fix api_version property
* add azure_ai img gen
* use AzureFoundryModelInfo
* get_base_image_generation_call_args
* add azure_ai/FLUX-1.1-pro
* add util for route_image_generation_cost_calculator
* docs azure ai flux
* fixes for flux
* fixes for AzureFoundryFluxImageGenerationConfig
* ruff fix
2025-08-13 17:20:30 -07:00
Ishaan Jaff and GitHub
fb325cbb5e
fix Build from litellm pip package ( #13603 )
2025-08-13 17:19:43 -07:00
Jugal Bhatt
4201f0aa79
Enhance Bedrock Provider Configuration and Header Management
...
- Added `forward_client_headers_to_llm_api` setting in the Bedrock documentation to facilitate client-side header forwarding.
- Updated `completion` function to use merged headers instead of original `extra_headers`.
- Improved request handling in `BedrockConverseLLM` and `AmazonInvokeConfig` to ensure proper header management for `anthropic-beta` parameters.
- Refactored request transformation logic to return the transformed request for better clarity and functionality.
2025-08-13 13:41:34 -07:00
a9d4f45a10
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com >
2025-08-13 13:18:37 -06:00
50de2a09e4
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com >
2025-08-13 13:18:26 -06:00
fffe6cb6fb
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com >
2025-08-13 13:13:20 -06:00
ede74a66d2
Update docs/my-website/docs/providers/heroku.md
...
Co-authored-by: Claire Riley <claire.riley@salesforce.com >
2025-08-13 13:13:11 -06:00
Jugal Bhatt
3990f61bed
Refactor Anthropic Configurations and Add Support for anthropic_beta Headers
...
- Renamed `AmazonAnthropicClaude3Config` and `AmazonAnthropicClaude3MessagesConfig` to `AmazonAnthropicClaudeConfig` and `AmazonAnthropicClaudeMessagesConfig` respectively for consistency.
- Implemented `get_anthropic_beta_from_headers` function to extract and handle `anthropic-beta` headers across various transformations.
- Updated request transformations in `AmazonConverseConfig` and `AmazonInvokeConfig` to include `anthropic_beta` parameters based on user headers.
- Added tests to ensure proper handling of `anthropic_beta` headers in different scenarios.
2025-08-13 11:47:59 -07:00
Dor Zion
6a1f5bdc2f
Add Noma Security guardrail support
2025-08-13 13:39:21 +03:00
nielsbosma
f2b0b6124c
feat(logging): add support for custom span names in Braintrust logging
2025-08-13 12:18:17 +02:00
TensorNull and GitHub
8de6f0b3ce
Merge branch 'BerriAI:main' into main
2025-08-13 15:23:47 +08:00
Krish Dholakia and GitHub
f00e891004
LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default ( #13555 )
...
* fix(litellm_proxy/chat/transformation.py): support 'user' and all other openai chat completion params
Fixes issue where 'user' was not being sent in request to litellm proxy via sdk
* fix(prisma_migration.py): remove 'use_prisma_migrate' flag, is now default
* docs: cleanup docs
* fix(proxy_cli.py): remove --use_prisma_migrate flag
* refactor: remove references to use_prisma_migrate env var
This is now the default flow for db migrations
2025-08-12 22:03:39 -07:00
TensorNull and GitHub
7cce327d09
Merge branch 'BerriAI:main' into main
2025-08-13 09:05:33 +08:00
Jorge Piedrahita Ortiz and GitHub
6a77780c0e
Feat/sambanova embeddings ( #13308 )
...
* add sambanova embeddings
* fmt
* minor fix
* add sambanova embeddings call
* fmt
* include embeddings in sambanova docs
* add sambanova embeddigns unit test
* remove unused import
* minor fix
* fmt
* update sambanova embeding to inherit from BaseEmbeddingConfig
* fmt
* fmt
* hot fix
* fmt
2025-08-12 17:15:26 -07:00
Ishaan Jaff and GitHub
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family ( #13346 )
...
* add openai.gpt-oss-20b-1:0
* update BEDROCK_CONVERSE_MODELS
* openai.gpt-oss-20b-1:0 fixes
* fix PDF input
* fix for should_fake_stream
* TestBedrockGPTOSS
* should_fake_stream
* update supports vision field for openai.gpt-oss models
* fixes for bedrock gpt oss
* fixes for should_fake_stream
* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
Timothy Lowrimore
bb259a651c
removes extraneous heading from readme
2025-08-12 09:11:16 -06:00
Timothy Lowrimore and GitHub
c0d82545d3
Merge branch 'main' into heroku-llms
2025-08-12 09:02:51 -06:00
