tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-18 16:18:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,331 Commits 2,072 Branches 1,425 Tags
ddec6c69c8ae2cb764eea408a2da2158b35239c1
Commit Graph
2812 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 45f465d84f Merge pull request #13572 from Noma-Security/noma-security-guardrails-support 
Add Noma Security guardrail support
 2025-08-26 23:15:17 -07:00
Ishaan JaffandGitHub ab7efaa832 test_pre_process_non_default_params (#13990) 2025-08-26 19:15:17 -07:00
Cole FrenchandGitHub 6696955506 [Bug]: Fix tests to reference moved attributes in braintrust_logging module (#13978) 
* Mock instance attribute moved from globals

* Support looking up mock message on mock choice
 2025-08-26 18:58:16 -07:00
Krish DholakiaandGitHub ae678a6642 Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata 
Feature/braintrust span name metadata
 2025-08-25 23:19:56 -07:00
Krish DholakiaandGitHub 3ed1220f75 Merge pull request #13916 from mubashir1osmani/openai-multiple-images 
feat: multiple images in openai images/edits endpoint
 2025-08-25 23:11:13 -07:00
Krish DholakiaandGitHub 22934907ba Merge pull request #13933 from michal-otmianowski/ignore-expired-s3-cache-entries 
Verify if cache entry has expired prior to serving it to client
 2025-08-25 23:10:48 -07:00
Krish DholakiaandGitHub b1bc8e3aa2 Merge pull request #13955 from ckoehler/push-oymwkvxmkqxv 
feat: add image headers for Copilot
 2025-08-25 23:04:24 -07:00
Ishaan JaffandGitHub 6ce1d82970 [Bug] Fix: Vertex Mistral not working for streaming (#13952) 
* fix OpenAI like chat handler

* fix MockResponse

* test_partner_models_httpx_streaming

* test_partner_models_httpx_streaming
 2025-08-25 17:39:40 -07:00
Christoph Koehler 04cca1e7f3 feat: add image headers for Copilot 
Fixes #13696. See issue for details.
 2025-08-25 18:15:26 -06:00
Ishaan JaffandGitHub c7b0c57b1e [Bug Fix] Azure Passthrough request with streaming (#13831) 
* fix: _update_stream_param_based_on_request_body

* test_update_stream_param_based_on_request_body

* test_pass_through_request_stream_param_override
 2025-08-25 14:11:17 -07:00
Ishaan JaffandGitHub 433d1a4947 [Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946) 
* use helper get_provider_specific_headers

* fix get_provider_specific_headers

* test_anthropic_messages_fallbacks

* bedrock/us.anthropic.claude-sonnet-4

* fix: get_provider_specific_headers

* TestProviderSpecificHeaderUtils

* test_anthropic_messages_fallbacks
 2025-08-25 13:44:54 -07:00
Michal Otmianowski c444263e7d verify expires field prior to serving cache entry 2025-08-25 10:42:12 +02:00
Steven Anton d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Ishaan Jaff e0e356e328 test mapped test fixes 2025-08-23 17:04:23 -07:00
mubashir1osmani 2fa8f971e0 feat: multiple images in openai images/edits endpoint 2025-08-23 19:13:32 -04:00
Ishaan Jaff 0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan JaffandGitHub b9132968b2 [Perf] Improvements for Async Success Handler (Logging Callbacks) - Approx +130 RPS (#13905) 
* [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895)

* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix

* create LoggingWorker

* add GLOBAL_LOGGING_WORKER for async task handling

* fix logging tests

* add conftest

* fix conftest

* test fix location of encode bedrock runtime modelid arn

* fix conftest.py

* tuning LoggingWorker

* conftest.py

* fix conftest batches/

* test_async_chat_azure

* event_loop

* test_bedrock_streaming_passthrough_test2

* fix GLOBAL_LOGGING_WORKER

* logging worker

* add flush for global logging worker

* Revert "fix GLOBAL_LOGGING_WORKER"

This reverts commit d254f508f48935652f054777652938ad71976cce.

* fix conftest clear_queue

* fix conftest clear_queue

* setup_and_teardown for llm translation

* docs AWS_REGION

* test_async_chat_azure

* change test DIR

* run ci/cd again

* use 1 job for litellm_router_unit_testing

* fix space

* fix litellm_router_unit_testing

* test_aaarouter_dynamic_cooldown_message_retry_time

* litellm_router_unit_testing

* conftest.py clearing qu

* fixes litellm_router_unit_testing

* fixes clear_queue

* fix router_unit_tests

* remove conftest

* add back conftest for router

* fix event loop test

* test fix

* fixes for LoggingWorker

* ruff fix
 2025-08-23 13:13:23 -07:00
Ishaan JaffandGitHub 9750374081 [Feat] New LLM API - AI/ML API for Image Gen (#13893) 
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
 2025-08-23 13:12:44 -07:00
Krish DholakiaandGitHub 9df6f4ef08 Merge branch 'main' into litellm_dev_08_20_2025_p1 2025-08-23 12:09:53 -07:00
Krrish Dholakia b23e35f75e test: update tests 2025-08-23 12:09:19 -07:00
Krish DholakiaandGitHub ef66bb87b3 Merge branch 'main' into litellm_dev_08_16_2025_p2 2025-08-23 11:30:51 -07:00
Krrish Dholakia 385bb15219 test: skip test 2025-08-23 11:27:46 -07:00
Krish DholakiaandGitHub 06a2915e9f Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1 
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
 2025-08-23 11:15:23 -07:00
Krrish Dholakia 4d7433b5ad test: reduce mistral direct tests b/c of rate limit errors 2025-08-23 11:15:03 -07:00
Krrish Dholakia cbb161f10b test: handle internal server errors 2025-08-23 11:00:18 -07:00
Krish DholakiaandGitHub f0b0ee51e0 Merge branch 'main' into litellm_dev_08_15_2025_p1 2025-08-23 10:51:56 -07:00
Krrish Dholakia ba9f6894b7 test: update tests 2025-08-23 10:42:41 -07:00
Krish DholakiaandGitHub 3e764ec268 Merge pull request #13808 from mainred/validate_api_version 
feat(utils.py): accept 'api_version' as param for validate_environment
 2025-08-22 23:59:38 -07:00
Krish DholakiaandGitHub 867b48a24f Merge pull request #13866 from jinskjoy/Mistral-File-ID 
[Enhancement] Add support for Mistral model file handling and update documentation
 2025-08-22 23:54:17 -07:00
Ishaan Jaff 825d6b08f0 test fix location of encode bedrock runtime modelid arn 2025-08-22 17:34:09 -07:00
Ishaan JaffandGitHub 56c16fc6f6 [Performance] Reduce Significant CPU overhead from litellm_logging.py (#13895) 
* fix: litellm.configured_cold_storage_logger

* fix Session Management - Non-OpenAI Models docs

* ruff fix

* test fix
 2025-08-22 16:17:57 -07:00
Jugal D. BhattandGitHub 3c1dcb64cc fix by adding init lock (#13666) 2025-08-22 11:42:43 -07:00
Krish DholakiaandGitHub dcad39c00f Merge pull request #13753 from RichardoC/fix-bedrock-irsa-role-assumption 
fix: role chaining and session name with webauthentication for aws bedrock
 2025-08-22 07:20:27 -07:00
Krish DholakiaandGitHub 59e43595b9 Merge pull request #13852 from michal-otmianowski/async-s3-implementation 
Async s3 implementation
 2025-08-21 23:19:51 -07:00
Krish DholakiaandGitHub 8b45e53878 Merge pull request #13880 from datarobot-forks/carsongee/improve_datarobot_api_handling 
🐛 Bug Fix: Updated URL handling for DataRobot provider URL
 2025-08-21 23:18:40 -07:00
Krish DholakiaandGitHub 9c4a86e98e Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model 
[Feat] Add support for voyage-context-3 embedding model
 2025-08-21 23:18:20 -07:00
Krish DholakiaandGitHub 6214d22126 Merge pull request #13863 from luizrennocosta/fix/pll-req-lim-v3-api-key 
fix: fixing descriptor/response size mismatch on parallel_request_limiter_v3
 2025-08-21 23:14:04 -07:00
Ishaan JaffandGitHub e93e266f84 [Performance] Use O(1) Set lookups for model routing (#13879) 
* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 620d14246980813366b4b1f1c0ce396b528dd9df.

* o(1) lookups

* Revert "o(1) lookups"

This reverts commit 676a9f5bcc3c2b9fa31e0a9fdf00389739b3052f.

* o(1) lookups

* register_model fix

* test_aget_valid_models

* lambda ai models fix

* test_utils.py

* test fix vertex ai
 2025-08-21 22:56:46 -07:00
Krish DholakiaandGitHub a61275f6e2 Merge pull request #13796 from 0x-fang/fix_aip_pass_through_08_20 
Fix(Bedrock): fix application inference profile for pass-through endpoints for bedrock
 2025-08-21 19:41:23 -07:00
Carson Gee b46de0ab5c Updated URL handling for DataRobot provider base 2025-08-21 19:42:46 -06:00
Krish DholakiaandGitHub 7c2c1c11d9 Merge pull request #13783 from philipkiely-baseten/main 
Update Baseten LiteLLM integration
 2025-08-21 18:34:36 -07:00
Ishaan JaffandGitHub 77a5de37b1 [Fix] Ensure Service Account Keys require team_id field on API Endpoints (#13873) 
* fixes for generating service accounts through the API

* fixes for test_update_service_account_works_with_team_id
 2025-08-21 14:55:06 -07:00
Sameer Kankute 5ac4fb512c Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
jinskjoy d8a33e137d [Enhancement] Add support for Mistral model file handling and update documentation 2025-08-21 20:35:07 +02:00
Philip Kiely 5fa4a18073 add testing and remove redundant function 2025-08-21 11:25:26 -07:00
Luiz Rennó Costa f8711200d0 fix: fixing descriptor/response size difference when indexing descriptor 2025-08-21 13:43:23 -03:00
Michal Otmianowski a6f052882b fix test 2025-08-21 12:10:29 +02:00
Michal Otmianowski feae09da5d minor adjustments 2025-08-21 11:33:11 +02:00