Ishaan Jaff
fb325cbb5e
fix Build from litellm pip package ( #13603 )
2025-08-13 17:19:43 -07:00
Krish Dholakia
f00e891004
LiteLLM SDK <-> Proxy: support user param + Prisma - remove use_prisma_migrate flag - redundant as this is now default ( #13555 )
...
* fix(litellm_proxy/chat/transformation.py): support 'user' and all other openai chat completion params
Fixes issue where 'user' was not being sent in request to litellm proxy via sdk
* fix(prisma_migration.py): remove 'use_prisma_migrate' flag, is now default
* docs: cleanup docs
* fix(proxy_cli.py): remove --use_prisma_migrate flag
* refactor: remove references to use_prisma_migrate env var
This is now the default flow for db migrations
2025-08-12 22:03:39 -07:00
Jorge Piedrahita Ortiz
6a77780c0e
Feat/sambanova embeddings ( #13308 )
...
* add sambanova embeddings
* fmt
* minor fix
* add sambanova embeddings call
* fmt
* include embeddings in sambanova docs
* add sambanova embeddigns unit test
* remove unused import
* minor fix
* fmt
* update sambanova embeding to inherit from BaseEmbeddingConfig
* fmt
* fmt
* hot fix
* fmt
2025-08-12 17:15:26 -07:00
Ishaan Jaff
828e3e3deb
[Feat] Add Streaming support + Docs for bedrock gpt-oss model family ( #13346 )
...
* add openai.gpt-oss-20b-1:0
* update BEDROCK_CONVERSE_MODELS
* openai.gpt-oss-20b-1:0 fixes
* fix PDF input
* fix for should_fake_stream
* TestBedrockGPTOSS
* should_fake_stream
* update supports vision field for openai.gpt-oss models
* fixes for bedrock gpt oss
* fixes for should_fake_stream
* docs bedrock gpt oss models
2025-08-12 08:39:36 -07:00
Ishaan Jaff
49ca4dc792
Sending tags to LiteLLM Proxy ( #13517 )
2025-08-11 17:58:50 -07:00
Ishaan Jaff
9f78287000
[Bug Fix]: Azure OpenAI GPT-5 max_tokens + reasoning param support ( #13510 )
...
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* add AzureOpenAIGPT5Config
* test_azure_gpt5_supports_reasoning_effort
* test_azure_gpt5_reasoning
* test_azure_gpt5_reasoning
* ruff check fixes
* docs azure gpt5
2025-08-11 15:40:53 -07:00
Krrish Dholakia
bd8a0ae0d0
docs: fix order
2025-08-10 09:42:55 -07:00
Krrish Dholakia
1dbac75675
docs(index.md): update release with deployment information
2025-08-10 09:31:28 -07:00
Krish Dholakia
c742c76288
Litellm release notes 08 10 2025 ( #13479 )
...
* docs(index.md): initial doc
* build(index.md): initial notes
* docs(index.md): add llm translation tickets
* docs(index.md): document new model support
* docs(index.md): document all pricing changes
* docs(index.md): add llm api endpoints
* docs(index.md): add doc on mcp gateway
* docs(index.md): add all remaining rc notes
* docs(index.md): cleanup
2025-08-10 07:32:11 -07:00
Krish Dholakia
9f6f96d76c
Litellm dev 08 07 2025 p1 ( #13418 )
...
* fix(router.py): support base model for model group usage
allows model group info to show accurate cost information for azure models
* fix(router.py): fix changes
* test: add unit tests
* build(pyproject.toml): bump openai version requirements
support custom tool from responses api
Closes https://github.com/BerriAI/litellm/issues/13391
* docs(responses_api.md): add verbosity + free-form function calling parameters
* docs(responses_api.md): add cfg + minimal reasoning to docs
Closes https://github.com/BerriAI/litellm/issues/13391
* docs(responses_api.md): add proxy examples to docs
* refactor: fix ruff error
2025-08-09 16:30:04 -07:00
Sannan Nasir
0e53b1feab
Add digitalocean provider ( #12169 )
...
* Add digitalocean provider
* Add digitalocean provider
* Revert "Add digitalocean provider"
This reverts commit 96dda40f45b3d12ea03e861d060ec81460b7759e.
* changes
* fixes
* Update transformation
* refactoring
* rename provider to Gradient AI
* fixes
* Incorporte review comments
* revert changes
* fix typo
* revert change
* incorporated review comments
* Revert "Incorporte review comments"
This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597.
* changes
* Revert "Revert "Incorporte review comments"
This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597."
This reverts commit 68c8a198ee0d6441c3a52f6c6a49c9c95a4cb0a8.
* changes
* fixes
* Update provider_specific_fields.tsx
2025-08-09 16:26:33 -07:00
Ishaan Jaff
ee40db7b31
docs native litellm prompts
2025-08-09 09:46:31 -07:00
Ishaan Jaff
94c33200a4
docs - native prompt mgmt ( #13463 )
2025-08-09 09:39:16 -07:00
Ishaan Jaff
3999e65a97
docs update
2025-08-09 09:24:41 -07:00
Jugal D. Bhatt
035e5497e0
added mcp guardrails doc in mcp.md ( #13452 )
2025-08-08 22:47:31 -07:00
Ishaan Jaff
7e2a00c848
[Docs] Add docs on how router / cooldowns work ( #13444 )
...
* add theme-mermaid
* docs cool down
* docs cooldown
2025-08-08 15:13:37 -07:00
Jugal D. Bhatt
3410b293d7
Add presidio docs ( #13392 )
2025-08-07 16:40:07 -07:00
Ishaan Jaff
2037037258
[Bug Fix] OpenAI gpt-5 series does not support "max_tokens" parameter and temperature values that are not = 1 ( #13390 )
...
* add OpenAIGPT5Config
* add map_openai_params for gpt5
* add OpenAIGPT5Config
* add OpenAI gpt 5 transform
* docs gpt 5 openai
2025-08-07 16:35:00 -07:00
breno-aumo
e8b4b25774
Update OCI docs ( #13336 )
...
* add oci models to model_prices_and_context_window.json
* remove unsupported and unavailable oci models from docs
2025-08-07 09:45:17 -07:00
Edward D'Amato
30fc5b871c
feat(integrations): allow setting of braintrust callback base url ( #13368 )
...
* feat(integrations): allow setting of braintrust callback base url
* chore(misc): remove extra additions due to merge
2025-08-07 08:40:11 -07:00
Ishaan Jaff
50c4a32c7d
docs claude-opus-4-1-20250805
2025-08-05 18:02:22 -07:00
Ishaan Jaff
dab8ba03e3
[Feat] - When using custom tags on prometheus allow using wildcard patterns ( #13316 )
...
* _tag_matches_wildcard_configured_pattern
* test_get_custom_labels_from_tags_wildcard_patterns
* docs Custom Tags
* docs how custom tags work
* fix
2025-08-05 17:46:13 -07:00
Jugal D. Bhatt
7524aa386c
[Redis IAM] Change documentation ( #13306 )
...
* change docs
* addde note
2025-08-05 15:04:46 -07:00
Jugal D. Bhatt
29a8c583c2
added redis iam auth ( #13275 )
2025-08-05 10:56:34 -07:00
Pascal Bro
a17d483c89
Add GCS bucket caching support ( #13122 )
2025-08-04 16:09:33 -07:00
breno-aumo
056b60a9fa
Support OCI provider ( #13206 )
...
* create OCI required files
* request and response conversion for non-streaming chat
* support tool calling with OCI generic API without streaming
* adaptation of api call for generic and cohere format
* include tool calls and responses in generic api and dropping support for cohere
* fix invalid content-length error
* support streaming for generic api
* fix auth error when using acompletion with streaming
* refactor: use base_llm_http_handler and include API type definitions
* update types and add type safety in different methods
* fix OCIFunction format
* create custom stream wrapper for decoding OCI stream
* remove unused files
* create unit tests for OCI
* lint the code
* remove manual test
* docs: update the docs to include OCI
2025-08-04 15:59:25 -07:00
Krrish Dholakia
747467c819
docs(user_keys.md): add litellm python sdk tab
2025-08-04 15:14:13 -07:00
Krrish Dholakia
bfecab2cc5
docs(index.md): cleanup tag
2025-08-04 14:18:04 -07:00
Krrish Dholakia
98102e2804
docs(index.md): cleanup
2025-08-02 23:06:46 -07:00
Ishaan Jaff
4c217c66f5
docs User Agent Activity Tracking
2025-08-02 17:26:40 -07:00
Ishaan Jaff
2ee4e84406
docs fix
2025-08-02 16:47:44 -07:00
Ishaan Jaff
06856b4d37
docs fix
2025-08-02 15:47:09 -07:00
Ishaan Jaff
0f9f5f7a6c
docs fix
2025-08-02 15:44:59 -07:00
Ishaan Jaff
69a360429c
agent 4.png
2025-08-02 15:34:14 -07:00
Ishaan Jaff
e32169dc37
docs cost tracking coding
2025-08-02 15:29:44 -07:00
Ishaan Jaff
340b64a46a
docs - Track Usage for Coding Tools
2025-08-02 15:18:04 -07:00
Ishaan Jaff
9b029c35be
docs RC
2025-08-02 15:06:12 -07:00
Ishaan Jaff
8d6b333909
docs computer use
2025-08-02 15:00:48 -07:00
Ishaan Jaff
e306fb6eee
[docs release notes] ( #13237 )
...
* docs release notes
* docs release notes
* docs rnotes
* docs api version
* fixes docs
* docs rn
2025-08-02 14:15:10 -07:00
Ishaan Jaff
5dfc88473f
fixes MCP gateway docs
2025-08-02 13:30:51 -07:00
Ishaan Jaff
6929767be2
docs release notes
2025-08-02 12:56:00 -07:00
Jugal D. Bhatt
a4c11600a9
[LLM] fix model reload on model update ( #13216 )
...
* fix model reload on model update
* remove the flag
2025-08-01 18:08:02 -07:00
Krrish Dholakia
3d02d3602e
docs(index.md): cleanup
2025-08-01 15:09:30 -07:00
Krish Dholakia
23dfab3737
Index.md - cleanup docs ( #13215 )
...
* docs: add highlights
* docs(index.md): add model-level guardrails
* docs(index.md): cleanup notes
* docs: fix docs
* docs: add more details
* docs(index.md): cleanup doc
2025-08-01 14:57:32 -07:00
Krrish Dholakia
3501ee7e82
docs(index.md): cleanup
2025-08-01 13:56:52 -07:00
Dmitry Tyumentsev
9955521194
allow redifine base api url in pass trough ( #13134 )
2025-07-31 22:38:33 -07:00
Ishaan Jaff
547c46cd02
add When to Use Each Endpoint ( #13193 )
2025-07-31 17:16:46 -07:00
Ishaan Jaff
ee70d593c1
[Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability ( #13158 )
...
* fix redact_standard_logging_payload
* add StandardCustomLoggerInitParams
* allow defining DatadogLLMObsInitParams
* fix init DataDogLLMObsLogger
* fix import
* update redact_standard_logging_payload_from_model_call_details
* test_dd_llms_obs_redaction
* docs DD logging
* docs DD
* docs DD
* Redacting Messages, Response docs DD LLM Obs
* fix redaction logic
* fix create_llm_obs_payload
* fix logging response
* fixes
* ruff fix
* fix test
* test_dd_llms_obs_redaction
* test_create_llm_obs_payload
* redact_standard_logging_payload_from_model_call_details
* img - dd_llm_obs
* docs DD
* fix linting
* fix linting
* fix mypy
* test_create_llm_obs_payload
* test_create_llm_obs_payload
* fix mock_env_vars
* fix _handle_anthropic_messages_response_logging
2025-07-31 16:44:16 -07:00
Ishaan Jaff
79be436c2b
[Feat] Background Health Checks - Allow disabling background health checks for a specific ( #13186 )
...
* disable background health checks for specific models
* test_background_health_check_skip_disabled_models
* Disable Background Health Checks For Specific Models
2025-07-31 13:48:35 -07:00
Krrish Dholakia
68177686e3
docs: cleanup
2025-07-30 10:21:45 -07:00