tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-12 11:07:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph

5306 Commits

Author SHA1 Message Date
Krrish Dholakia fb5b2d8d47 docs: remove old doc 
prevent showing up on searches
 2025-08-20 15:01:32 -07:00
Ishaan Jaff 55dcaded72 [Feat] Add VertexAI qwen API Service (#13828) 
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
 2025-08-20 15:00:33 -07:00
Ishaan Jaff e229a6a796 security fix 2025-08-20 08:35:59 -07:00
mubashir1osmani ef9e50458d removed faq 2025-08-19 17:01:31 -04:00
mubashir1osmani 2edcc51e57 updated claude-code docs and deployment faq 2025-08-19 16:52:46 -04:00
Philip Kiely 7c3d522435 Update Baseten LiteLLM integration 2025-08-19 12:21:05 -07:00
Krish Dholakia 422447b7f1 Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses 
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
 2025-08-18 18:59:28 -07:00
Krrish Dholakia 0459604721 docs: document new param 2025-08-18 18:56:39 -07:00
Ishaan Jaff ba0881d728 [Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735) 
* add image edits litellm proxy on SDK

* add image gen provider

* add IMG Gen support for litellm_proxy provider
 2025-08-18 18:26:32 -07:00
Ishaan Jaff eee93e250a docs v1.75.5-stable 2025-08-18 09:23:18 -07:00
TensorNull 159cfe5b4c Merge branch 'BerriAI:main' into main 2025-08-18 09:46:12 +08:00
Krrish Dholakia 21549a3463 docs(index.md): write up on session management 2025-08-16 17:55:18 -07:00
Krrish Dholakia cb95f2d5d7 docs(index.md): clarify risk of upgrade 2025-08-16 17:38:50 -07:00
Krrish Dholakia 788a1d03a1 docs(index.md): cleanup 2025-08-16 17:33:07 -07:00
Krrish Dholakia 235b6b040f docs(index.md): add highlight note on redis latency improvements 2025-08-16 17:32:45 -07:00
Krrish Dholakia 8a75ab8388 docs(index.md): cleanup doc 2025-08-16 17:16:04 -07:00
Ishaan Jaff 5889311b10 [Docs] v1.75.8-stable (#13676) 
* v1-75-8

* fix responses API docs

* docs fix

* docs fix new models

* docs links

* docs fix links

* docs sambanova

* docs fix
 2025-08-16 09:20:04 -07:00
Krish Dholakia f360e0ead2 Merge pull request #13590 from BerriAI/litellm_bedrock_api_header 
[LLM translation] Refactor Anthropic Configurations and Add Support for `anthropic_beta` Headers
 2025-08-14 11:32:18 -07:00
Ishaan Jaff 5bb96af818 [Feat] Add reasoning_effort param for hosted_vllm provider (#13620) 
* add reasoning_effort to hosted_vllm

* test_hosted_vllm_supports_reasoning_effort

* Reasoning Effort
 2025-08-14 10:10:30 -07:00
Ishaan Jaff 76d25926d4 [Feat] New provider - Azure AI Flux Image Generation (#13592) 
* init files

* add AzureFoundryModelInfo

* fix api_version property

* add azure_ai img gen

* use AzureFoundryModelInfo

* get_base_image_generation_call_args

* add azure_ai/FLUX-1.1-pro

* add util for route_image_generation_cost_calculator

* docs azure ai flux

* fixes for flux

* fixes for AzureFoundryFluxImageGenerationConfig

* ruff fix
 2025-08-13 17:20:30 -07:00
Ishaan Jaff fb325cbb5e fix Build from litellm pip package (#13603) 2025-08-13 17:19:43 -07:00
Jugal Bhatt 4201f0aa79 Enhance Bedrock Provider Configuration and Header Management 
- Added `forward_client_headers_to_llm_api` setting in the Bedrock documentation to facilitate client-side header forwarding.
- Updated `completion` function to use merged headers instead of original `extra_headers`.
- Improved request handling in `BedrockConverseLLM` and `AmazonInvokeConfig` to ensure proper header management for `anthropic-beta` parameters.
- Refactored request transformation logic to return the transformed request for better clarity and functionality.
 2025-08-13 13:41:34 -07:00
Timothy Lowrimore a9d4f45a10 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-13 13:18:37 -06:00
Timothy Lowrimore 50de2a09e4 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-13 13:18:26 -06:00
Timothy Lowrimore fffe6cb6fb Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-13 13:13:20 -06:00
Timothy Lowrimore ede74a66d2 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-13 13:13:11 -06:00
Jugal Bhatt 3990f61bed Refactor Anthropic Configurations and Add Support for anthropic_beta Headers 
- Renamed `AmazonAnthropicClaude3Config` and `AmazonAnthropicClaude3MessagesConfig` to `AmazonAnthropicClaudeConfig` and `AmazonAnthropicClaudeMessagesConfig` respectively for consistency.
- Implemented `get_anthropic_beta_from_headers` function to extract and handle `anthropic-beta` headers across various transformations.
- Updated request transformations in `AmazonConverseConfig` and `AmazonInvokeConfig` to include `anthropic_beta` parameters based on user headers.
- Added tests to ensure proper handling of `anthropic_beta` headers in different scenarios.
 2025-08-13 11:47:59 -07:00
Dor Zion 6a1f5bdc2f Add Noma Security guardrail support 2025-08-13 13:39:21 +03:00
nielsbosma f2b0b6124c feat(logging): add support for custom span names in Braintrust logging 2025-08-13 12:18:17 +02:00
TensorNull 8de6f0b3ce Merge branch 'BerriAI:main' into main 2025-08-13 15:23:47 +08:00
Krish Dholakia f00e891004 LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default (#13555) 
* fix(litellm_proxy/chat/transformation.py): support 'user' and all other openai chat completion params

Fixes issue where 'user' was not being sent in request to litellm proxy via sdk

* fix(prisma_migration.py): remove 'use_prisma_migrate' flag, is now default

* docs: cleanup docs

* fix(proxy_cli.py): remove --use_prisma_migrate flag

* refactor: remove references to use_prisma_migrate env var

This is now the default flow for db migrations
 2025-08-12 22:03:39 -07:00
TensorNull 7cce327d09 Merge branch 'BerriAI:main' into main 2025-08-13 09:05:33 +08:00
Jorge Piedrahita Ortiz 6a77780c0e Feat/sambanova embeddings (#13308) 
* add sambanova embeddings

* fmt

* minor fix

* add sambanova embeddings call

* fmt

* include embeddings in sambanova docs

* add sambanova embeddigns unit test

* remove unused import

* minor fix

* fmt

* update sambanova embeding to inherit from BaseEmbeddingConfig

* fmt

* fmt

* hot fix

* fmt
 2025-08-12 17:15:26 -07:00
Ishaan Jaff 828e3e3deb [Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
 2025-08-12 08:39:36 -07:00
Timothy Lowrimore bb259a651c removes extraneous heading from readme 2025-08-12 09:11:16 -06:00
Timothy Lowrimore c0d82545d3 Merge branch 'main' into heroku-llms 2025-08-12 09:02:51 -06:00
Timothy Lowrimore cccf41c0df Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:46:48 -06:00
Timothy Lowrimore 1342abf163 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:46:16 -06:00
Timothy Lowrimore 586c0a7be5 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:47 -06:00
Timothy Lowrimore 7b0ecb1847 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:36 -06:00
Timothy Lowrimore d4e320a4ce Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:21 -06:00
Timothy Lowrimore 5857d17fad Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:45:06 -06:00
Timothy Lowrimore 3cfb85228f Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:44:52 -06:00
Timothy Lowrimore 417b18a727 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:42:46 -06:00
Timothy Lowrimore fa587c2eba Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:42:27 -06:00
Timothy Lowrimore 1be33ec47f Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:38 -06:00
Timothy Lowrimore 00c9f1fe0e Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:22 -06:00
Timothy Lowrimore e97fa833b3 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:41:08 -06:00
Timothy Lowrimore b20b28a912 Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:40:54 -06:00
Timothy Lowrimore e2165ff76e Update docs/my-website/docs/providers/heroku.md 
Co-authored-by: Claire Riley <claire.riley@salesforce.com>
 2025-08-12 08:40:43 -06:00