tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-11 11:04:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph

5648 Commits

Author SHA1 Message Date
YutaSaito 12bc66aa5b Merge pull request #19623 from BerriAI/litellm_fix_completions_mcp_output_ordering 
[fix] completions mcp output ordering
 2026-01-23 15:56:02 +09:00
Yuta Saito 6a60b3d848 test: completions mcp output test 2026-01-23 15:17:14 +09:00
John Greek 26a2c90818 [Fix] Anthropic models on Azure AI cache pricing (#19532) (#19614) 2026-01-22 20:00:40 -08:00
Ishaan Jaff c23e4b87dc [Feat] New LiteLLM Policy engine - create policies to manage guardrails, conditions - permissions per Key, Team (#19612) 
* init PolicyMatcher

* TestPolicyMatcherGetMatchingPolicies

* TestPolicyMatcherGetMatchingPolicies

* feat: init PolicyResolver

* init resolver types

* init policy from config

* inint PolicyValidator

* validate policy

* init Architecture Diagram

* test_add_guardrails_from_policy_engine

* init _init_policy_engine

* test updates

* test fixws

* new attachment config

* simplify types

* TestPolicyResolverInheritance

* fix policy resolver

* fix policies

* fix applied policy

* docs fix

* docs fix

* fix linting + QA checks

* fix linting + QA fixes

* test fixes
 2026-01-22 19:49:53 -08:00
Sameer Kankute ebf0beda97 Fix: litellm/tests/test_proxy_server_non_root.py 2026-01-23 08:58:56 +05:30
yuneng-jiang 827ce52d80 Adding retries to flaky tests 2026-01-22 15:21:44 -08:00
yuneng-jiang 5c29eeea30 Merge pull request #19585 from BerriAI/litellm_cicd_fix_yj_015 
[Infra] CI/CD - Fix Non Root Proxy Tests
 2026-01-22 11:31:50 -08:00
yuneng-jiang 24e90ec467 Merge pull request #19583 from BerriAI/litellm_cicd_fix_yj_014 
[Infra] CI/CD - Updating Prometheus Tests
 2026-01-22 11:16:38 -08:00
yuneng-jiang a7bafadd26 Fix non-root proxy tests 2026-01-22 11:15:18 -08:00
yuneng-jiang dbe6f66baf updating promethus tests 2026-01-22 11:01:01 -08:00
Alexsander Hamir 57d777bc69 Fix unsafe access to request attribute (#19573) 2026-01-22 10:58:29 -08:00
yuneng-jiang dcb111a48b skip brave tests 2026-01-22 10:50:23 -08:00
mpcusack-altos 88f8f49e1d fix(websearch_interception): filter internal kwargs before follow-up request (#19577) 
The websearch interception handler was passing internal flags like
`_websearch_interception_converted_stream` to the follow-up LLM request.
This caused "Extra inputs are not permitted" errors from providers like
Bedrock that use strict Pydantic validation.

Fix: Filter out all kwargs starting with `_websearch_interception` prefix
before making the follow-up anthropic_messages.acreate() call.
 2026-01-22 10:42:20 -08:00
Eric Cao a51835dfcc Metrics prometheus user team count (#19520) 
* add user count and team count prometheus metrics

* rebase

* revert mistaken deletion
 2026-01-22 08:17:15 -08:00
Sameer Kankute ddaf127b4a Merge pull request #19562 from BerriAI/litellm_stop_setting 
feat: Limit stop sequence as per openai spec
 2026-01-22 19:44:56 +05:30
Sameer Kankute 842e5b3ad6 Merge pull request #19560 from BerriAI/litellm_bedrock_invoke_structured_output 
[Feat] Add support for output formatfor bedrock invoke via v1/messages
 2026-01-22 19:44:48 +05:30
Sameer Kankute c78c878822 Merge pull request #19558 from BerriAI/litellm_gemini_vertexai_mapping 
Add custom vertex ai mapping to the output
 2026-01-22 19:44:32 +05:30
Sameer Kankute 73715ab417 Merge pull request #19556 from BerriAI/litellm_fix_gemini_batch_jan22 
Fix: generation config empty for batch
 2026-01-22 19:44:26 +05:30
Sameer Kankute f312bf23d0 Fix:test_multiple_function_call 2026-01-22 19:34:54 +05:30
Sameer Kankute 991fee056f Fix batch tests 2026-01-22 19:23:32 +05:30
Yuta Saito 8a622c51f5 feat: Add MCP tools response to chat completions 2026-01-22 19:23:32 +05:30
Sameer Kankute b729622bf5 Fix: generationConfig removal from tests 2026-01-22 19:00:37 +05:30
Sameer Kankute 110e2c69d4 Fix : test_anthropic_via_responses_api 2026-01-22 18:28:56 +05:30
Sameer Kankute caab7821bd Fix: imagegeneration@006 has been deprecated 2026-01-22 18:24:59 +05:30
Sameer Kankute ad1edd38d5 Merge branch 'main' into litellm_staging_01_21_2026 2026-01-22 17:56:40 +05:30
Sameer Kankute 4d20c8fbc0 feat: Limit stop sequence as per openai spec 2026-01-22 17:52:13 +05:30
Sameer Kankute 24faca9bcf Add support for output formatfor bedrock invoke via v1/messages 2026-01-22 16:36:03 +05:30
Sameer Kankute 18240662db Add custom vertex ai mapping to the output 2026-01-22 15:18:24 +05:30
Yuta Saito ed67bf2705 feat: Add MCP tools response to chat completions 2026-01-22 15:32:04 +09:00
Ishaan Jaff a117509f93 [Fix] UI Cost Estimator - Fix model dropdown (#19529) 
* add cost estimator

* ui fix show errors

* test_estimate_cost_resolves_router_model_alias
 2026-01-21 20:19:40 -08:00
Harshit Jain 746414eb9b Fix/per service ssl override v2 (#19538) 
* refactor(ssl): support per-service SSL verification overrides

* add test cases for ssl
 2026-01-21 20:10:04 -08:00
davida-ps 7777aeb695 fixing prompt-security's guardrail implementation (#19374) 
* Consolidated change

* fix(prompt_security): update message processing to persist sanitized files and filter for API calls

* fix per krrishdholakia suggestion
 2026-01-21 20:09:40 -08:00
Ishaan Jaff ab606c9a73 [Feat] Add Structured output for /v1/messages with Anthropic API, Azure Anthropic API, Bedrock Converse (#19545) 
* fix: add AnthropicMessagesRequestOptionalParams

* add _update_headers_with_anthropic_beta

* fix output format tests

* test_structured_output_e2e

* TestAnthropicAPIStructuredOutput

* test_structured_output_e2e

* fix BASE

* TestAzureAnthropicStructuredOutput

* fix: Bedrock Converse

* add nthropic Messages Pass-Through Architecture

* fix: bedrock invoke output_format

* fix: transform_anthropic_messages_request for vertex anthropic

* TestBedrockInvokeStructuredOutput

* docs anthropic vertex

* docs fix

* docs fix
 2026-01-21 20:09:18 -08:00
jay prajapati 363b0cc132 fix(azure): preserve content_policy_violation details for images (#19328) (#19372) 
Azure OpenAI Images (DALL·E 3) returns policy violations as a structured payload under body["error"], including inner_error.content_filter_results and revised_prompt.

LiteLLM previously:
- Failed to extract nested error messages (get_error_message only handled body["message"])
- Missed policy violation detection when error strings were generic
- Dropped inner_error details when raising ContentPolicyViolationError

This change:
- Extracts nested Azure error fields (code/type/message + inner_error)
- Detects policy violations via structured error codes
- Passes an OpenAI-style error body + provider_specific_fields to preserve details

Tests:
- python3 -m pytest tests/test_litellm/llms/azure/test_azure_exception_mapping.py
- python3 -m pytest tests/test_litellm/litellm_core_utils/test_exception_mapping_utils.py

Fixes #19328
 2026-01-21 20:06:51 -08:00
Ishaan Jaff d5e912322f [Fix] VertexAI Pass through - Ensure only anthropic betas are forwarded down to LLM API (#19542) 
* fix ALLOWED_VERTEX_AI_PASSTHROUGH_HEADERS

* test_vertex_passthrough_forwards_anthropic_beta_header

* fix test_vertex_passthrough_forwards_anthropic_beta_header

* test_vertex_passthrough_does_not_forward_litellm_auth_token

* fix utils

* Using Anthropic Beta Features on Vertex AI

* test_forward_headers_from_request_x_pass_prefix
 2026-01-21 19:12:04 -08:00
yuneng-jiang 6b6785bc4f Merge pull request #19539 from BerriAI/litellm_models_scope 
[Feature] Adding Optional scope Param to /models
 2026-01-21 17:41:22 -08:00
yuneng-jiang c6b157832b Merge pull request #19296 from BerriAI/litellm_esca_reissue 
[Reissue: Fix] /user/new Privilege Escalation
 2026-01-21 16:46:34 -08:00
yuneng-jiang 6723b30d03 Adding scope to /models 2026-01-21 16:40:31 -08:00
Yuta Saito 898cc3ff4f test: update langfuse trace_id tests to use litellm_trace_id 2026-01-22 06:19:43 +09:00
YutaSaito 4a14a53ae8 Merge pull request #19469 from BerriAI/litellm_feat_mcp_spendlogs 
[feat] mcp spendlogs
 2026-01-22 05:29:21 +09:00
Ishaan Jaff 5cb5969a26 [Fix] LiteLLM VertexAI Pass through - ensuring incoming headers are forwarded down to target (#19524) 
* test_vertex_passthrough_forwards_anthropic_beta_header

* add_incoming_headers
 2026-01-21 12:01:33 -08:00
yuneng-jiang d0e35751a1 Fixing tests and linting 2026-01-21 11:02:39 -08:00
yuneng-jiang b5a7d2ab34 Paginating model/info endpoint 2026-01-21 10:44:18 -08:00
John Greek aa4b0e0149 Fix duplicate test_handler.py filenames causing pytest collection errors (#19385) 2026-01-21 08:47:50 -08:00
Sameer Kankute 95dc14e400 Merge pull request #19389 from BerriAI/litellm_timeout_fix 
Fix: total timeout is not respected
 2026-01-21 19:16:11 +05:30
Sameer Kankute e758dd0a59 Merge pull request #19472 from BerriAI/litellm_fix_chat_completion_responses_streaming 
Fix: tool call streaming in chat completion bridge
 2026-01-21 19:15:53 +05:30
Sameer Kankute 540370a1aa Merge pull request #19479 from BerriAI/litellm_sarvam_int 
Add support for sarvam models
 2026-01-21 19:03:52 +05:30
Sameer Kankute b6691baf24 Merge pull request #19482 from BerriAI/litellm_anthropic_max_length 
Filter out unsupported fields from JSON schema for Anthropic's output_format API.
 2026-01-21 18:57:16 +05:30
Sameer Kankute e315e4cd7c fix litellm/tests/litellm_utils_tests/test_utils.py 2026-01-21 18:50:02 +05:30
Sameer Kankute aeb38ffa9b Merge pull request #19497 from BerriAI/main 
merge main
 2026-01-21 18:43:27 +05:30