Commit Graph

5434 Commits

Author SHA1 Message Date
Sameer Kankute ca06bb4e3a Merge pull request #19201 from BerriAI/litellm_fix_vertex_ai_structured_output2
Fix: vertex ai doesn't support structured output
2026-01-16 17:09:03 +05:30
Sameer Kankute 09fb1581cb Fix:add async_get_available_deployment_for_pass_through in code tests 2026-01-16 16:37:44 +05:30
Sameer Kankute b0c6a1b308 Merge pull request #19203 from BerriAI/main
merge main
2026-01-16 15:16:29 +05:30
Sameer Kankute ac5a4df724 Fix: vertex ai doesn't support structured output 2026-01-16 14:54:31 +05:30
YutaSaito 45d38bea5b Merge pull request #19188 from BerriAI/litellm_fix_ci_security_tests
[chore] add jaraco liccheck
2026-01-16 14:55:51 +09:00
Yuta Saito 9e1235c0aa chore: add jaraco liccheck 2026-01-16 14:55:14 +09:00
Sameer Kankute 9ac490de62 Merge pull request #19179 from BerriAI/litellm_fix_streaming_chunk
Fix : test_stream_chunk_builder_litellm_mixed_calls
2026-01-16 10:52:25 +05:30
Sameer Kankute aec1990dc2 Fix : test_streaming_multiple_partial_tool_calls 2026-01-16 09:29:54 +05:30
Yuta Saito 3a55f68ea4 test: handle wildcard routes in route validation test 2026-01-16 12:53:27 +09:00
YutaSaito f123e08b16 Merge pull request #19178 from BerriAI/litellm_fix_ci_litellm_mapped_tests_llms
[tests] skip Azure SDK init check for acreate_skill
2026-01-16 12:17:55 +09:00
Yuta Saito 1c38847b17 tests: skip Azure SDK init check for acreate_skill 2026-01-16 12:03:38 +09:00
YutaSaito 3d80432675 Merge pull request #19175 from BerriAI/revert-19053-litellm_intern_user_usage
Revert "[Fix] /team/daily/activity Show Internal Users Their Spend Only"
2026-01-16 11:50:36 +09:00
John Greek 07b1f84ec6 fix(bedrock): strip throughput tier suffixes from model names (#19147)
Co-authored-by: Greek, John <jgreek@users.noreply.github.com>
2026-01-15 18:43:10 -08:00
YutaSaito bbf9a9e6e6 Revert "[Fix] /team/daily/activity Show Internal Users Their Spend Only" 2026-01-16 11:27:59 +09:00
Ishaan Jaff 117c7dd158 [Feat] Claude Code - Add End-user tracking with Claude Code (#19171)
* add claude code customer usage tracking

* fix get end user trackign claude code

* TestGetCustomerIdFromStandardHeaders
2026-01-15 17:57:10 -08:00
YutaSaito 9de97b9724 Merge pull request #19170 from BerriAI/litellm_fix_ci_check_code_and_doc_quality
Litellm fix ci check code and doc quality
2026-01-16 10:41:51 +09:00
Yuta Saito c03630d95e test: fix missing test 2026-01-16 10:33:53 +09:00
YutaSaito 05a1d15c65 Merge pull request #19168 from BerriAI/revert-19027-litellm_add_0_budget_model_bypass
Revert "[Feat] Add support for 0 cost models"
2026-01-16 10:21:51 +09:00
Yuta Saito 993742166d test: fix router_code_coverage test fail 2026-01-16 10:16:01 +09:00
Ishaan Jaff 362b1a1577 [Feat] Add support for Tool Search on /messages API - Azure, Bedrock, Anthropic API (#19165)
* fix _update_headers_with_anthropic_beta

* init ANTHROPIC_BETA_HEADER_VALUES

* fix ANTHROPIC_BETA_HEADER_VALUES

* fix: _update_headers_with_anthropic_beta - anthropic API

* init _update_headers_with_anthropic_beta - azure AI support

* init VertexAIPartnerModelsAnthropicMessagesConfig

* fix _get_total_tokens_from_usage

* working TestBedrockInvokeToolSearch

* fix get_extra_headers

* TestBedrockInvokeToolSearch

* _get_tool_search_beta_header_for_bedrock

* fix mypy linting
2026-01-15 16:35:00 -08:00
YutaSaito 960bdbbd8e Revert "[Feat] Add support for 0 cost models" 2026-01-16 09:33:38 +09:00
yuneng-jiang 6a7edd8f2b Merge pull request #18785 from BerriAI/litellm_user_promethus_metrics
[Feature] User Metrics for Promethus
2026-01-15 15:51:02 -08:00
yuneng-jiang e07106244e Merge pull request #19116 from BerriAI/litellm_org_admin_escalte
[Fix] /user/new Privilege Escalation
2026-01-15 15:50:43 -08:00
Cesar Garcia 8a3a0f4db1 chore: remove unused test files from repository root (#19150)
Remove orphaned test files that are not referenced in any tests or code:
- flux2_test_image.png
- test_generic_guardrail_config.yaml
- test_image_edit.png (root only, tests/image_gen_tests/ copy preserved)
- document.txt
- batch_small.jsonl (root and tests/batches_tests/)
2026-01-16 02:34:41 +05:30
Vikash c619569604 Added ability to customize logfire base url through env var (#19148)
* Added ability to customize logfire base url through env var

* Added test to check if env var is used correctly for logfire

* Document the env var

* Documented env var in config_settings.md
2026-01-16 00:10:59 +05:30
Sameer Kankute 8b7c36c271 Merge pull request #19135 from BerriAI/litellm_websocker_realtime_fix
Fix model name from query param in realtime request
2026-01-15 22:26:28 +05:30
Sameer Kankute 8c454eb74f Fix: mock test tests 2026-01-15 22:02:51 +05:30
Sameer Kankute 83e33944ef Fix: mock test tests 2026-01-15 22:02:42 +05:30
Sameer Kankute 890fa85a33 Fix: response enterprise tests 2026-01-15 21:25:22 +05:30
Sameer Kankute b4ee1b2589 Fix: response enterprise tests 2026-01-15 19:53:04 +05:30
Sameer Kankute 4bdda9cc28 Fix: tests/test_litellm/proxy/test_proxy_server.py::test_embedding_input_array_of_tokens 2026-01-15 19:46:35 +05:30
Sameer Kankute f28d951202 Fix: tests/test_litellm/proxy/test_litellm_pre_call_utils.py::test_embedding_header_forwarding_with_model_group 2026-01-15 19:41:16 +05:30
Sameer Kankute 3af994a32a Fix: test router 2026-01-15 19:21:31 +05:30
Sameer Kankute 83cdfd886a Merge pull request #19059 from BerriAI/litellm_openrouter_image_gen
Add openrouter support for image/generation endpoints
2026-01-15 15:48:00 +05:30
Sameer Kankute e9a2999f61 Fix: handling of model name in query param 2026-01-15 15:06:37 +05:30
YutaSaito f541bc0261 Merge pull request #19129 from BerriAI/litellm_fix_mcp_chat_completions
[fix] mcp chat completions
2026-01-15 18:21:37 +09:00
Yuta Saito 1c2942d808 test: add mcp completions test 2026-01-15 15:47:45 +09:00
Yuta Saito ba43f742ab fix: event loop nesting issue in MCP chat completions with streaming
Problem: When using MCP tools with  and , the following error occurred:

RuntimeError: Timeout context manager should be used inside a task
2026-01-15 15:36:56 +09:00
Sameer Kankute dca42047b9 Merge pull request #19068 from BerriAI/litellm_responses_caching_support
[Fix] Add support for caching for responses API
2026-01-15 08:38:31 +05:30
yuneng-jiang 27bc5c1fca Merge pull request #19120 from BerriAI/litellm_yj_triage_branch
[Fix] Azure Storage Circular Reference Error
2026-01-14 18:08:38 -08:00
Ishaan Jaff 458f773861 [Feat] Claude Code - Add support for Prompt Caching with Bedrock Converse (#19123)
* init BaseAnthropicMessagesPromptCachingTest

* fix UsageDelta

* fix: _create_initial_usage_delta

* TestBedrockInvokePromptCaching

* translate_anthropic_messages_to_openai wiht cache control

* fix translate_anthropic_messages_to_openai
2026-01-14 18:05:10 -08:00
Ishaan Jaff e67e9e7054 [Fix] Containers API - Allow routing to regional endpoints (#19118)
* fix get_complete_url

* fix url resolution containers API

* TestContainerRegionalApiBase
2026-01-14 17:28:18 -08:00
yuneng-jiang 97c39dbb7a Fixing circular reference for azure storage 2026-01-14 16:11:55 -08:00
Ishaan Jaff 62187103b4 [Fix] Containers API - Container API routes return 401 for non-admin users - routes missing from openai_routes (#19115)
* test_containers_routes_are_llm_api_routes

* allow /containers/* API
2026-01-14 15:14:03 -08:00
yuneng-jiang 30859d763e Fix user escalation 2026-01-14 15:13:25 -08:00
Ishaan Jaff 06ded8750e [Fix] Claude Code (/messages) - Litellm fix claude code Bedrock Invoke usage, request signing (#19111)
* test_should_not_fail_with_forwarded_headers_bedrock_invoke_messages

* use common get_request_headers for BaseAWS

* fix get_request_headers

* test_should_not_fail_with_forwarded_headers_bedrock_invoke_messages
2026-01-14 14:51:50 -08:00
yuneng-jiang dcac090de0 Merge pull request #19053 from BerriAI/litellm_intern_user_usage
[Fix] /team/daily/activity Show Internal Users Their Spend Only
2026-01-14 13:47:34 -08:00
Ishaan Jaff 747829dadb [Fix] Claude Code + Bedrock Converse Usage - ensure budget tokens are passed to converse api correctly (#19107)
* test_bedrock_converse_budget_tokens_preserved

* test_openai_model_with_thinking_converts_to_reasoning_effort

* fix translate_anthropic_thinking_to_reasoning_effort

* test_bedrock_converse_budget_tokens_preserved

* test_anthropic_messages_bedrock_converse_with_thinking
2026-01-14 12:02:27 -08:00
Rayan Pal f880ea537f fix(vertex): add type object to tool schemas missing type field (#19103)
Tools with no parameters (like EnterPlanMode from Anthropic Agents SDK)
send schemas with only $schema and no type field. Gemini rejects these
with "functionDeclaration parameters schema should be of type OBJECT".

Adds type: object when schema has no type and no anyOf/oneOf/allOf.
2026-01-15 00:43:35 +05:30
Rayan Pal d92a0168cc fix: keep type field in Gemini schema when properties is empty (#18979) 2026-01-14 22:58:05 +05:30