tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-13 14:23:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,272 Commits 2,072 Branches 1,425 Tags
68aaeb4f4a4bc5b260dab31bf1167fcd70b655db
Commit Graph
24272 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub 68aaeb4f4a Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports 
Fix missing and unused imports in custom_guardrail docs example
 2025-08-25 00:57:46 -07:00
Krish DholakiaandGitHub 0d285c8b4c Merge pull request #13919 from stevenmanton/fix-aws-assume-role-with-token 
Add support for AWS assume_role with a session token
 2025-08-25 00:55:02 -07:00
Krish DholakiaandGitHub a7bb5bc814 Merge pull request #13922 from ArthurRenault/patch-1 
[BUG] Add back supervisor to non-root image
 2025-08-25 00:54:18 -07:00
ArthurandGitHub 6c97a31c9c bug: add supervisor to non-root image 2025-08-24 15:43:57 +02:00
Steven Anton d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Ishaan Jaff 827d1def02 UI new build v1.76.0-nightly 2025-08-23 17:12:09 -07:00
Ishaan Jaff 373a13f9d4 ui fix logos 2025-08-23 17:10:18 -07:00
Ishaan Jaff 65adddd91e fix callback logos 2025-08-23 17:08:18 -07:00
Ishaan JaffandGitHub f4de167654 [Feat] UI QA Fixes (#13915) 
* fix add fallbacks page

* leftnav - allow expand / collapse
 2025-08-23 17:05:25 -07:00
Ishaan Jaff e0e356e328 test mapped test fixes 2025-08-23 17:04:23 -07:00
Yuta Saito cca1ea1592 Fix missing and unused imports in custom_guardrail docs example 2025-08-24 08:37:17 +09:00
Krish DholakiaandGitHub 242c06e691 Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Ishaan Jaff 8a8b6f6b2c ui new build 2025-08-23 14:18:38 -07:00
Ishaan Jaff 0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff 835879bc85 fix: img gen 2025-08-23 14:03:11 -07:00
Ishaan Jaff f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan Jaff 58c413d7ab use litellm-proxy-extras==0.2.18 v1.76.0-stable-draft 2025-08-23 13:27:26 -07:00
Mubashir OsmaniandGitHub 1a8d3cc2d5 Added FAQ under deployment docs (#13912) 
* updated faq questions

* updated faq

* added faq under deployment
 2025-08-23 13:22:56 -07:00
Ishaan Jaff e637930d6d fix Providers UI 2025-08-23 13:16:40 -07:00
Ishaan JaffandGitHub b9132968b2 [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f48935652f054777652938ad71976cce.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
 2025-08-23 13:13:23 -07:00
Ishaan JaffandGitHub 9750374081 [Feat] New LLM API - AI/ML API for Image Gen (#13893) 
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
 2025-08-23 13:12:44 -07:00
Krrish Dholakia 511630dc7e fix: fix transformation 2025-08-23 12:50:57 -07:00
Krish DholakiaandGitHub a5b12c9ce1 Merge pull request #13830 from BerriAI/litellm_dev_08_20_2025_p1 
Fix calling key with access to model alias
 2025-08-23 12:10:03 -07:00
Krish DholakiaandGitHub 9df6f4ef08 Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
Krrish Dholakia b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krish DholakiaandGitHub 49cb9bdbca Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3 
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
 2025-08-23 12:06:01 -07:00
Krrish Dholakia 988434a49d fix: fix linting error 2025-08-23 11:49:12 -07:00
Krish DholakiaandGitHub f2c5e806b4 Merge pull request #13673 from BerriAI/litellm_dev_08_16_2025_p2 
fix(openai/image_edits): Support 'mask' parameter for openai image edits
 2025-08-23 11:30:57 -07:00
Krish DholakiaandGitHub ef66bb87b3 Merge branch 'main' into litellm_dev_08_16_2025_p2 2025-08-23 11:30:51 -07:00
Krrish Dholakia 385bb15219 test: skip test 2025-08-23 11:27:46 -07:00
Krish DholakiaandGitHub 06a2915e9f Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1 
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
 2025-08-23 11:15:23 -07:00
Krrish Dholakia 4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krrish Dholakia cbb161f10b test: handle internal server errors 2025-08-23 11:00:18 -07:00
Krish DholakiaandGitHub f0b0ee51e0 Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krrish Dholakia 45d32dc90f fix: fix ruff check 2025-08-23 10:51:17 -07:00
Krrish Dholakia 75d75aff39 fix: fix ruff check 2025-08-23 10:49:17 -07:00
Krrish Dholakia 3b22fb4215 test: update tests 2025-08-23 10:49:03 -07:00
Krrish Dholakia eb7e5e3a71 Revert "build(model_prices_and_context_window.json): remove retired dbrx model" 
This reverts commit 10d49d0174.
 2025-08-23 10:47:44 -07:00
Krrish Dholakia ba9f6894b7 test: update tests 2025-08-23 10:42:41 -07:00
Krrish Dholakia 7637e41019 fix: fix ruff check 2025-08-23 10:36:53 -07:00
tanjiroandKrrish Dholakia a7231507dd new notifications (#13861) 2025-08-23 10:36:52 -07:00
Krrish Dholakia f6851db0eb fix(internal_user_endpoints.py): show remaining users when free SSO users is enabled 2025-08-23 10:36:52 -07:00
Krrish Dholakia a6380a4355 feat(ui_sso.py): initial commit adding free SSO for up to 5 users 
Fixes https://github.com/BerriAI/litellm/issues/13031
 2025-08-23 10:36:52 -07:00
Krrish Dholakia 10d49d0174 build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-23 10:36:52 -07:00
Krrish Dholakia c270c5a37a build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-23 10:36:52 -07:00
mubashir1osmani d664860aa1 added openai models to config 2025-08-23 10:02:49 -04:00
Krish DholakiaandGitHub 3e764ec268 Merge pull request #13808 from mainred/validate_api_version 
feat(utils.py): accept 'api_version' as param for validate_environment
 2025-08-22 23:59:38 -07:00
Krish DholakiaandGitHub 33206d2fcd Merge pull request #13848 from Ithanil/fix_non-root_migrations 
fix permission access on prisma migrate in non-root image
 2025-08-22 23:55:31 -07:00
Krish DholakiaandGitHub 867b48a24f Merge pull request #13866 from jinskjoy/Mistral-File-ID 
[Enhancement] Add support for Mistral model file handling and update documentation
 2025-08-22 23:54:17 -07:00