d6cd50dfdb
feat: Add support for custom Anthropic-compatible API endpoints
...
This commit adds support for custom Anthropic-compatible API endpoints
that don't follow the standard /v1/messages or /v1/complete path convention.
## Changes
- Added LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX environment variable
- When set to true, prevents automatic appending of /v1/messages (for anthropic)
- When set to true, prevents automatic appending of /v1/complete (for anthropic_text)
- Added debug logging to indicate when suffix is being skipped
- Maintained full backward compatibility - existing deployments are unaffected
2025-08-26 01:22:51 +08:00
c1ee8c26af
[UI QA] - Allow setting Team Member RPM/TPM limits when creating a team ( #13943 )
...
* allow setting team_member_rpm_limit on creating
* create_team_member_rate_limits
* docs fix
* fix img
2025-08-25 09:12:50 -07:00
7c5e9b666b
update release notes
2025-08-25 08:17:30 -07:00
68aaeb4f4a
Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports
...
Fix missing and unused imports in custom_guardrail docs example
2025-08-25 00:57:46 -07:00
0d285c8b4c
Merge pull request #13919 from stevenmanton/fix-aws-assume-role-with-token
...
Add support for AWS assume_role with a session token
2025-08-25 00:55:02 -07:00
a7bb5bc814
Merge pull request #13922 from ArthurRenault/patch-1
...
[BUG] Add back supervisor to non-root image
2025-08-25 00:54:18 -07:00
6c97a31c9c
bug: add supervisor to non-root image
2025-08-24 15:43:57 +02:00
d95578464e
Add support for AWS assume_role with a session token
2025-08-23 22:37:21 -07:00
827d1def02
UI new build
2025-08-23 17:12:09 -07:00
373a13f9d4
ui fix logos
2025-08-23 17:10:18 -07:00
65adddd91e
fix callback logos
2025-08-23 17:08:18 -07:00
f4de167654
[Feat] UI QA Fixes ( #13915 )
...
* fix add fallbacks page
* leftnav - allow expand / collapse
2025-08-23 17:05:25 -07:00
e0e356e328
test mapped test fixes
2025-08-23 17:04:23 -07:00
cca1ea1592
Fix missing and unused imports in custom_guardrail docs example
2025-08-24 08:37:17 +09:00
242c06e691
Merge pull request #13784 from mubashir1osmani/docs-deploy
2025-08-23 15:40:34 -07:00
8a8b6f6b2c
ui new build
2025-08-23 14:18:38 -07:00
0fccd619ea
test_vertex_ai_deepseek
2025-08-23 14:13:03 -07:00
cf64033044
test fix
2025-08-23 14:04:41 -07:00
835879bc85
fix: img gen
2025-08-23 14:03:11 -07:00
f1c710a608
test_e2e_generate_cold_storage_object_key_not_configured
2025-08-23 13:33:33 -07:00
58c413d7ab
use litellm-proxy-extras==0.2.18
2025-08-23 13:27:26 -07:00
1a8d3cc2d5
Added FAQ under deployment docs ( #13912 )
...
* updated faq questions
* updated faq
* added faq under deployment
2025-08-23 13:22:56 -07:00
e637930d6d
fix Providers UI
2025-08-23 13:16:40 -07:00
b9132968b2
[Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS ( #13905 )
...
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895 )
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
* create LoggingWorker
* add GLOBAL_LOGGING_WORKER for async task handling
* fix logging tests
* add conftest
* fix conftest
* test fix location of encode bedrock runtime modelid arn
* fix conftest.py
* tuning LoggingWorker
* conftest.py
* fix conftest batches/
* test_async_chat_azure
* event_loop
* test_bedrock_streaming_passthrough_test2
* fix GLOBAL_LOGGING_WORKER
* logging worker
* add flush for global logging worker
* Revert "fix GLOBAL_LOGGING_WORKER"
This reverts commit d254f508f48935652f054777652938ad71976cce.
* fix conftest clear_queue
* fix conftest clear_queue
* setup_and_teardown for llm translation
* docs AWS_REGION
* test_async_chat_azure
* change test DIR
* run ci/cd again
* use 1 job for litellm_router_unit_testing
* fix space
* fix litellm_router_unit_testing
* test_aaarouter_dynamic_cooldown_message_retry_time
* litellm_router_unit_testing
* conftest.py clearing qu
* fixes litellm_router_unit_testing
* fixes clear_queue
* fix router_unit_tests
* remove conftest
* add back conftest for router
* fix event loop test
* test fix
* fixes for LoggingWorker
* ruff fix
2025-08-23 13:13:23 -07:00
9750374081
[Feat] New LLM API - AI/ML API for Image Gen ( #13893 )
...
* add LlmProviders.AIML
* add AIMLChatConfig
* add aiml
* fix AimlImageGenerationConfig
* add AimlImageGenerationConfig
* add cost_calculator
* fixes for AI ML API
* add known AIML Flux image models
* add AIML Cost Calc
* add AI/ML API
* add aiml_models
2025-08-23 13:12:44 -07:00
511630dc7e
fix: fix transformation
2025-08-23 12:50:57 -07:00
a5b12c9ce1
Merge pull request #13830 from BerriAI/litellm_dev_08_20_2025_p1
...
Fix calling key with access to model alias
2025-08-23 12:10:03 -07:00
9df6f4ef08
Merge branch 'main' into litellm_dev_08_20_2025_p1
2025-08-23 12:09:53 -07:00
b23e35f75e
test: update tests
2025-08-23 12:09:19 -07:00
49cb9bdbca
Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3
...
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
2025-08-23 12:06:01 -07:00
988434a49d
fix: fix linting error
2025-08-23 11:49:12 -07:00
f2c5e806b4
Merge pull request #13673 from BerriAI/litellm_dev_08_16_2025_p2
...
fix(openai/image_edits): Support 'mask' parameter for openai image edits
2025-08-23 11:30:57 -07:00
ef66bb87b3
Merge branch 'main' into litellm_dev_08_16_2025_p2
2025-08-23 11:30:51 -07:00
385bb15219
test: skip test
2025-08-23 11:27:46 -07:00
06a2915e9f
Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1
...
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
2025-08-23 11:15:23 -07:00
4d7433b5ad
test: reduce mistral direct tests b/c of rate limit errors
2025-08-23 11:15:03 -07:00
cbb161f10b
test: handle internal server errors
2025-08-23 11:00:18 -07:00
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1
2025-08-23 10:51:56 -07:00
45d32dc90f
fix: fix ruff check
2025-08-23 10:51:17 -07:00
75d75aff39
fix: fix ruff check
2025-08-23 10:49:17 -07:00
3b22fb4215
test: update tests
2025-08-23 10:49:03 -07:00
eb7e5e3a71
Revert "build(model_prices_and_context_window.json): remove retired dbrx model"
...
This reverts commit 10d49d0174
2025-08-23 10:47:44 -07:00
ba9f6894b7
test: update tests
2025-08-23 10:42:41 -07:00
7637e41019
fix: fix ruff check
2025-08-23 10:36:53 -07:00
a7231507dd
new notifications ( #13861 )
2025-08-23 10:36:52 -07:00
f6851db0eb
fix(internal_user_endpoints.py): show remaining users when free SSO users is enabled
2025-08-23 10:36:52 -07:00
a6380a4355
feat(ui_sso.py): initial commit adding free SSO for up to 5 users
...
Fixes https://github.com/BerriAI/litellm/issues/13031
2025-08-23 10:36:52 -07:00
10d49d0174
build(model_prices_and_context_window.json): remove retired dbrx model
2025-08-23 10:36:52 -07:00
c270c5a37a
build(model_prices_and_context_window.json): remove deprecated model from model cost map
2025-08-23 10:36:52 -07:00
d664860aa1
added openai models to config
2025-08-23 10:02:49 -04:00
0x5751