tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-06 20:25:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,907 Commits 2,072 Branches 1,425 Tags
2d4c0f4e65d12e15e22d8f402904dbb02eaffd89
Commit Graph
5669 Commits
Author SHA1 Message Date
xqe2011andGitHub ca8c2c3938 fix #19620: SSO user roles are not updated for existing users (#19621) 
* Fix: SSO user roles are not updated for existing users
Fixes #19620

* Refactor: Remove redundant user_info retrieval in SSOAuthenticationHandler

* Test: add new tests for user creation and updates in get_user_info_from_db
 2026-01-23 09:05:29 -08:00
Sameer KankuteandGitHub 9894721285 Merge pull request #19548 from BerriAI/litellm_staging_01_22_2026 
Litellm staging 01 22 2026
 2026-01-23 20:03:11 +05:30
Sameer KankuteandGitHub 23f7d4f0b0 Merge pull request #19645 from BerriAI/litellm_gigachat_big_fix 
Add tool choice mapping for giga chat
 2026-01-23 19:52:35 +05:30
Sameer KankuteandGitHub a240eb7630 Merge pull request #19649 from BerriAI/litellm_fix_responses_api_logging_eror 
Fix: Responses API logging error for StopIteration
 2026-01-23 19:51:45 +05:30
Sameer Kankute a4bf14f6e7 Fix: test_nova_invoke_streaming_chunk_parsing 2026-01-23 19:49:42 +05:30
Sameer Kankute 8357d05615 Fix: Responses API logging error for StopIteration 2026-01-23 18:42:33 +05:30
YutaSaitoandGitHub 8ac1d96d90 Merge pull request #19634 from BerriAI/litellm_feat_hashicorp_rotate 
[feat] hashicorp vault rotate support
 2026-01-23 21:08:55 +09:00
Sameer Kankute acf5ad1155 Add tool choice mapping for giga chat 2026-01-23 16:29:19 +05:30
Sameer KankuteandGitHub 12463809bd Merge pull request #19638 from BerriAI/main 
merge main in stagin 1 22 26
 2026-01-23 14:54:17 +05:30
Yuta Saito 695fbf4ec5 feat: hashicorp vault rotate support 2026-01-23 17:32:55 +09:00
Yuta Saito 919033a6d0 fix: include tool arguments in proxy_server_request for spend logs callbacks 2026-01-23 16:36:37 +09:00
YutaSaitoandGitHub 4381e7f98f Merge pull request #19624 from BerriAI/litellm_test_responses_api_with_mcp_tools 
[test] Skip anthropic model test when ANTHROPIC_API_KEY is not set
 2026-01-23 15:58:19 +09:00
YutaSaitoandGitHub 12bc66aa5b Merge pull request #19623 from BerriAI/litellm_fix_completions_mcp_output_ordering 
[fix] completions mcp output ordering
 2026-01-23 15:56:02 +09:00
Yuta Saito 1ae9189ff8 test: Skip anthropic model test when ANTHROPIC_API_KEY is not set 2026-01-23 15:50:56 +09:00
Yuta Saito 6a60b3d848 test: completions mcp output test 2026-01-23 15:17:14 +09:00
John GreekandGitHub 26a2c90818 [Fix] Anthropic models on Azure AI cache pricing (#19532) (#19614) 2026-01-22 20:00:40 -08:00
Harshit JainandGitHub 69c8698e62 fix: pass through endpoints update registry (#19420) 
* fix: pass through endpoints update registry

* add test case, fix lint error and comment to avoid confusion

* fix pass through endpoints test case
 2026-01-22 19:57:48 -08:00
Ishaan JaffandGitHub c23e4b87dc [Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team (#19612) 
* init PolicyMatcher

* TestPolicyMatcherGetMatchingPolicies

* TestPolicyMatcherGetMatchingPolicies

* feat: init PolicyResolver

* init resolver types

* init policy from config

* inint PolicyValidator

* validate policy

* init Architecture Diagram

* test_add_guardrails_from_policy_engine

* init _init_policy_engine

* test updates

* test fixws

* new attachment config

* simplify types

* TestPolicyResolverInheritance

* fix policy resolver

* fix policies

* fix applied policy

* docs fix

* docs fix

* fix linting + QA checks

* fix linting + QA fixes

* test fixes
 2026-01-22 19:49:53 -08:00
Sameer Kankute ebf0beda97 Fix: litellm/tests/test_proxy_server_non_root.py 2026-01-23 08:58:56 +05:30
yuneng-jiang 827ce52d80 Adding retries to flaky tests 2026-01-22 15:21:44 -08:00
yuneng-jiangandGitHub 5c29eeea30 Merge pull request #19585 from BerriAI/litellm_cicd_fix_yj_015 
[Infra] CI/CD - Fix Non Root Proxy Tests
 2026-01-22 11:31:50 -08:00
yuneng-jiangandGitHub 24e90ec467 Merge pull request #19583 from BerriAI/litellm_cicd_fix_yj_014 
[Infra] CI/CD - Updating Prometheus Tests
 2026-01-22 11:16:38 -08:00
yuneng-jiang a7bafadd26 Fix non-root proxy tests 2026-01-22 11:15:18 -08:00
yuneng-jiang dbe6f66baf updating promethus tests 2026-01-22 11:01:01 -08:00
Alexsander HamirandGitHub 57d777bc69 Fix unsafe access to request attribute (#19573) 2026-01-22 10:58:29 -08:00
yuneng-jiang dcb111a48b skip brave tests 2026-01-22 10:50:23 -08:00
mpcusack-altosandGitHub 88f8f49e1d fix(websearch_interception): filter internal kwargs before follow-up request (#19577) 
The websearch interception handler was passing internal flags like
`_websearch_interception_converted_stream` to the follow-up LLM request.
This caused "Extra inputs are not permitted" errors from providers like
Bedrock that use strict Pydantic validation.

Fix: Filter out all kwargs starting with `_websearch_interception` prefix
before making the follow-up anthropic_messages.acreate() call.
 2026-01-22 10:42:20 -08:00
Eric CaoandGitHub a51835dfcc Metrics prometheus user team count (#19520) 
* add user count and team count prometheus metrics

* rebase

* revert mistaken deletion
 2026-01-22 08:17:15 -08:00
Sameer KankuteandGitHub ddaf127b4a Merge pull request #19562 from BerriAI/litellm_stop_setting 
feat: Limit stop sequence as per openai spec
 2026-01-22 19:44:56 +05:30
Sameer KankuteandGitHub 842e5b3ad6 Merge pull request #19560 from BerriAI/litellm_bedrock_invoke_structured_output 
[Feat] Add support for output formatfor bedrock invoke via v1/messages
 2026-01-22 19:44:48 +05:30
Sameer KankuteandGitHub c78c878822 Merge pull request #19558 from BerriAI/litellm_gemini_vertexai_mapping 
Add custom vertex ai mapping to the output
 2026-01-22 19:44:32 +05:30
Sameer KankuteandGitHub 73715ab417 Merge pull request #19556 from BerriAI/litellm_fix_gemini_batch_jan22 
Fix: generation config empty for batch
 2026-01-22 19:44:26 +05:30
Sameer Kankute f312bf23d0 Fix:test_multiple_function_call 2026-01-22 19:34:54 +05:30
Sameer Kankute 991fee056f Fix batch tests 2026-01-22 19:23:32 +05:30
Yuta SaitoandSameer Kankute 8a622c51f5 feat: Add MCP tools response to chat completions 2026-01-22 19:23:32 +05:30
Sameer Kankute b729622bf5 Fix: generationConfig removal from tests 2026-01-22 19:00:37 +05:30
Sameer Kankute 110e2c69d4 Fix : test_anthropic_via_responses_api 2026-01-22 18:28:56 +05:30
Sameer Kankute caab7821bd Fix: imagegeneration@006 has been deprecated 2026-01-22 18:24:59 +05:30
Sameer KankuteandGitHub ad1edd38d5 Merge branch 'main' into litellm_staging_01_21_2026 2026-01-22 17:56:40 +05:30
Sameer Kankute 4d20c8fbc0 feat: Limit stop sequence as per openai spec 2026-01-22 17:52:13 +05:30
Sameer Kankute 24faca9bcf Add support for output formatfor bedrock invoke via v1/messages 2026-01-22 16:36:03 +05:30
Sameer Kankute 18240662db Add custom vertex ai mapping to the output 2026-01-22 15:18:24 +05:30
Yuta Saito ed67bf2705 feat: Add MCP tools response to chat completions 2026-01-22 15:32:04 +09:00
Will ChenandGitHub 9f57eb3e74 Fix Azure AI costs for Anthropic models (#19530) 
* Fix Azure AI cost calculation

* fixup
 2026-01-21 21:10:27 -08:00
Emerson GomesandGitHub a3f7f5858b Fix date overflow/division by zero in proxy utils (#19527) 
* Fix date overflow/division by zero in proxy utils

* Fix projected spend calculation

* Strengthen projected spend tests
 2026-01-21 21:09:57 -08:00
Yogeshwaran RavichandranandGitHub ab274ac3c4 fix(azure response api): flatten tools for responses api to support nested definitions (#19526) 
The Azure Responses API uses a different schema (flattened) for tools compared to the standard OpenAI/Azure Chat Completions API (nested). This caused a `BadRequestError` when users passed standard tool definitions.

Changes:
- Implemented tool flattening logic in `AzureOpenAIResponsesAPIConfig.transform_responses_api_request`.
- Added comprehensive unit tests in test_azure_transformation.py to verify nested-to-flat transformation, pass-through of flat tools, and immutability.
- Ensures cross-provider compatibility for tool definitions.

Fixes #19523
 2026-01-21 21:08:28 -08:00
Emerson GomesandGitHub c8669cf8fa Fix Azure RPM calculation formula (#19513) 
* Fix Azure RPM calculation formula

* updated test
 2026-01-21 21:03:23 -08:00
João Dinis FerreiraandGitHub 60840ea292 fix(bedrock): correct streaming choice index for tool calls (#19506) 
Bedrock's contentBlockIndex identifies content blocks within a message
(text=0, tool_call=1), not OpenAI's choice index (which varies with n>1).
This caused OpenAI SDK's ChatCompletionAccumulator to fail when tool call
chunks arrived on index 1 while finish_reason arrived on index 0.

Bedrock doesn't support n>1 (no such parameter exists):
https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_InferenceConfiguration.html

OpenAI choice index spec:
https://platform.openai.com/docs/api-reference/chat/streaming
 2026-01-21 20:57:14 -08:00
Harshit JainandGitHub 22000f3beb fix: add case-insensitive support for guardrail mode and actions (#19480) 2026-01-21 20:52:57 -08:00
Ishaan JaffandGitHub a117509f93 [Fix] UI Cost Estimator - Fix model dropdown (#19529) 
* add cost estimator

* ui fix show errors

* test_estimate_cost_resolves_router_model_alias
 2026-01-21 20:19:40 -08:00