Commit Graph

24262 Commits

Author SHA1 Message Date
Krrish Dholakia 66acf6dcdb docs(index.md): initial commit with release notes 2025-08-23 15:45:06 -07:00
Krish Dholakia 242c06e691 Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Ishaan Jaff 8a8b6f6b2c ui new build 2025-08-23 14:18:38 -07:00
Ishaan Jaff 0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff 835879bc85 fix: img gen 2025-08-23 14:03:11 -07:00
Ishaan Jaff f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan Jaff 58c413d7ab use litellm-proxy-extras==0.2.18 v1.76.0-stable-draft 2025-08-23 13:27:26 -07:00
Mubashir Osmani 1a8d3cc2d5 Added FAQ under deployment docs (#13912)
* updated faq questions

* updated faq

* added faq under deployment
2025-08-23 13:22:56 -07:00
Ishaan Jaff e637930d6d fix Providers UI 2025-08-23 13:16:40 -07:00
Ishaan Jaff b9132968b2 [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905)
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f48935652f054777652938ad71976cce.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
2025-08-23 13:13:23 -07:00
Ishaan Jaff 9750374081 [Feat] New LLM API - AI/ML API for Image Gen (#13893)
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
2025-08-23 13:12:44 -07:00
Krrish Dholakia 511630dc7e fix: fix transformation 2025-08-23 12:50:57 -07:00
Krish Dholakia a5b12c9ce1 Merge pull request #13830 from BerriAI/litellm_dev_08_20_2025_p1
Fix calling key with access to model alias
2025-08-23 12:10:03 -07:00
Krish Dholakia 9df6f4ef08 Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
Krrish Dholakia b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krish Dholakia 49cb9bdbca Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
2025-08-23 12:06:01 -07:00
Krrish Dholakia 988434a49d fix: fix linting error 2025-08-23 11:49:12 -07:00
Krish Dholakia f2c5e806b4 Merge pull request #13673 from BerriAI/litellm_dev_08_16_2025_p2
fix(openai/image_edits): Support 'mask' parameter for openai image edits
2025-08-23 11:30:57 -07:00
Krish Dholakia ef66bb87b3 Merge branch 'main' into litellm_dev_08_16_2025_p2 2025-08-23 11:30:51 -07:00
Krrish Dholakia 385bb15219 test: skip test 2025-08-23 11:27:46 -07:00
Krish Dholakia 06a2915e9f Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
2025-08-23 11:15:23 -07:00
Krrish Dholakia 4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krrish Dholakia cbb161f10b test: handle internal server errors 2025-08-23 11:00:18 -07:00
Krish Dholakia f0b0ee51e0 Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krrish Dholakia 45d32dc90f fix: fix ruff check 2025-08-23 10:51:17 -07:00
Krrish Dholakia 75d75aff39 fix: fix ruff check 2025-08-23 10:49:17 -07:00
Krrish Dholakia 3b22fb4215 test: update tests 2025-08-23 10:49:03 -07:00
Krrish Dholakia eb7e5e3a71 Revert "build(model_prices_and_context_window.json): remove retired dbrx model"
This reverts commit 10d49d0174.
2025-08-23 10:47:44 -07:00
Krrish Dholakia ba9f6894b7 test: update tests 2025-08-23 10:42:41 -07:00
Krrish Dholakia 7637e41019 fix: fix ruff check 2025-08-23 10:36:53 -07:00
tanjiro a7231507dd new notifications (#13861) 2025-08-23 10:36:52 -07:00
Krrish Dholakia f6851db0eb fix(internal_user_endpoints.py): show remaining users when free SSO users is enabled 2025-08-23 10:36:52 -07:00
Krrish Dholakia a6380a4355 feat(ui_sso.py): initial commit adding free SSO for up to 5 users
Fixes https://github.com/BerriAI/litellm/issues/13031
2025-08-23 10:36:52 -07:00
Krrish Dholakia 10d49d0174 build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-23 10:36:52 -07:00
Krrish Dholakia c270c5a37a build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-23 10:36:52 -07:00
mubashir1osmani d664860aa1 added openai models to config 2025-08-23 10:02:49 -04:00
Krish Dholakia 3e764ec268 Merge pull request #13808 from mainred/validate_api_version
feat(utils.py): accept 'api_version' as param for validate_environment
2025-08-22 23:59:38 -07:00
Krish Dholakia 33206d2fcd Merge pull request #13848 from Ithanil/fix_non-root_migrations
fix permission access on prisma migrate in non-root image
2025-08-22 23:55:31 -07:00
Krish Dholakia 867b48a24f Merge pull request #13866 from jinskjoy/Mistral-File-ID
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
Krish Dholakia 28ea6cd35f Merge pull request #13899 from TeddyAmkie/docs/team-rate-limits-update
docs: clarify prerequisites and env var for team rate limits
2025-08-22 23:50:24 -07:00
Krish Dholakia 28a11d8376 Merge pull request #13897 from kankute-sameer/litellm_openrouter_deepseek_chat_v3.1
Add openrouter deepseek/deepseek-chat-v3.1 support
2025-08-22 23:50:04 -07:00
Krish Dholakia 558c0940b2 Merge pull request #13902 from bcdonadio/litellm_ollama_tools_transforms
Fix Ollama transformations crash when tools are used with non-tool trained models
2025-08-22 23:49:31 -07:00
Ishaan Jaff f9e9f8c25e docs AWS_REGION 2025-08-22 17:48:37 -07:00
Ishaan Jaff 825d6b08f0 test fix location of encode bedrock runtime modelid arn 2025-08-22 17:34:09 -07:00
Ishaan Jaff 56c16fc6f6 [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
2025-08-22 16:17:57 -07:00
Bernardo Donadio 6384595289 Fix transformations crash when tools are being used 2025-08-22 17:28:52 -03:00
Jugal D. Bhatt 3c1dcb64cc fix by adding init lock (#13666) 2025-08-22 11:42:43 -07:00
Teddy Amkie 08d1c96ed1 docs: clarify prerequisites and env var for team rate limits 2025-08-22 18:39:31 +00:00
Sameer Kankute f239a0f78a Add openrouter deepseek/deepseek-chat-v3.1 support 2025-08-22 22:59:09 +05:30