tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-10 16:22:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,280 Commits 2,072 Branches 1,425 Tags
3bb6046ca03a4648fdfde3f01427cc2daec6f763
Commit Graph
5410 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 362b1a1577 [Feat] Add support for Tool Search on /messages API - Azure, Bedrock, Anthropic API (#19165) 
* fix _update_headers_with_anthropic_beta

* init ANTHROPIC_BETA_HEADER_VALUES

* fix ANTHROPIC_BETA_HEADER_VALUES

* fix: _update_headers_with_anthropic_beta - anthropic API

* init _update_headers_with_anthropic_beta - azure AI support

* init VertexAIPartnerModelsAnthropicMessagesConfig

* fix _get_total_tokens_from_usage

* working TestBedrockInvokeToolSearch

* fix get_extra_headers

* TestBedrockInvokeToolSearch

* _get_tool_search_beta_header_for_bedrock

* fix mypy linting
 2026-01-15 16:35:00 -08:00
yuneng-jiangandGitHub 6a7edd8f2b Merge pull request #18785 from BerriAI/litellm_user_promethus_metrics 
[Feature] User Metrics for Promethus
 2026-01-15 15:51:02 -08:00
yuneng-jiangandGitHub e07106244e Merge pull request #19116 from BerriAI/litellm_org_admin_escalte 
[Fix] /user/new Privilege Escalation
 2026-01-15 15:50:43 -08:00
Cesar GarciaandGitHub 8a3a0f4db1 chore: remove unused test files from repository root (#19150) 
Remove orphaned test files that are not referenced in any tests or code:
- flux2_test_image.png
- test_generic_guardrail_config.yaml
- test_image_edit.png (root only, tests/image_gen_tests/ copy preserved)
- document.txt
- batch_small.jsonl (root and tests/batches_tests/)
 2026-01-16 02:34:41 +05:30
VikashandGitHub c619569604 Added ability to customize logfire base url through env var (#19148) 
* Added ability to customize logfire base url through env var

* Added test to check if env var is used correctly for logfire

* Document the env var

* Documented env var in config_settings.md
 2026-01-16 00:10:59 +05:30
Sameer KankuteandGitHub 8b7c36c271 Merge pull request #19135 from BerriAI/litellm_websocker_realtime_fix 
Fix model name from query param in realtime request
 2026-01-15 22:26:28 +05:30
Sameer Kankute 8c454eb74f Fix: mock test tests 2026-01-15 22:02:51 +05:30
Sameer Kankute 83e33944ef Fix: mock test tests 2026-01-15 22:02:42 +05:30
Sameer Kankute 890fa85a33 Fix: response enterprise tests 2026-01-15 21:25:22 +05:30
Sameer Kankute b4ee1b2589 Fix: response enterprise tests 2026-01-15 19:53:04 +05:30
Sameer Kankute 4bdda9cc28 Fix: tests/test_litellm/proxy/test_proxy_server.py::test_embedding_input_array_of_tokens 2026-01-15 19:46:35 +05:30
Sameer Kankute f28d951202 Fix: tests/test_litellm/proxy/test_litellm_pre_call_utils.py::test_embedding_header_forwarding_with_model_group 2026-01-15 19:41:16 +05:30
Sameer Kankute 3af994a32a Fix: test router 2026-01-15 19:21:31 +05:30
Sameer KankuteandGitHub 83cdfd886a Merge pull request #19059 from BerriAI/litellm_openrouter_image_gen 
Add openrouter support for image/generation endpoints
 2026-01-15 15:48:00 +05:30
Sameer Kankute e9a2999f61 Fix: handling of model name in query param 2026-01-15 15:06:37 +05:30
YutaSaitoandGitHub f541bc0261 Merge pull request #19129 from BerriAI/litellm_fix_mcp_chat_completions 
[fix] mcp chat completions
 2026-01-15 18:21:37 +09:00
Yuta Saito 1c2942d808 test: add mcp completions test 2026-01-15 15:47:45 +09:00
Yuta Saito ba43f742ab fix: event loop nesting issue in MCP chat completions with streaming 
Problem: When using MCP tools with  and , the following error occurred:

RuntimeError: Timeout context manager should be used inside a task
 2026-01-15 15:36:56 +09:00
Sameer KankuteandGitHub dca42047b9 Merge pull request #19068 from BerriAI/litellm_responses_caching_support 
[Fix] Add support for caching for responses API
 2026-01-15 08:38:31 +05:30
yuneng-jiangandGitHub 27bc5c1fca Merge pull request #19120 from BerriAI/litellm_yj_triage_branch 
[Fix] Azure Storage Circular Reference Error
 2026-01-14 18:08:38 -08:00
Ishaan JaffandGitHub 458f773861 [Feat] Claude Code - Add support for Prompt Caching with Bedrock Converse (#19123) 
* init BaseAnthropicMessagesPromptCachingTest

* fix UsageDelta

* fix: _create_initial_usage_delta

* TestBedrockInvokePromptCaching

* translate_anthropic_messages_to_openai wiht cache control

* fix translate_anthropic_messages_to_openai
 2026-01-14 18:05:10 -08:00
Ishaan JaffandGitHub e67e9e7054 [Fix] Containers API - Allow routing to regional endpoints (#19118) 
* fix get_complete_url

* fix url resolution containers API

* TestContainerRegionalApiBase
 2026-01-14 17:28:18 -08:00
yuneng-jiang 97c39dbb7a Fixing circular reference for azure storage 2026-01-14 16:11:55 -08:00
Ishaan JaffandGitHub 62187103b4 [Fix] Containers API - Container API routes return 401 for non-admin users - routes missing from openai_routes (#19115) 
* test_containers_routes_are_llm_api_routes

* allow /containers/* API
 2026-01-14 15:14:03 -08:00
yuneng-jiang 30859d763e Fix user escalation 2026-01-14 15:13:25 -08:00
Ishaan JaffandGitHub 06ded8750e [Fix] Claude Code (/messages) - Litellm fix claude code Bedrock Invoke usage, request signing (#19111) 
* test_should_not_fail_with_forwarded_headers_bedrock_invoke_messages

* use common get_request_headers for BaseAWS

* fix get_request_headers

* test_should_not_fail_with_forwarded_headers_bedrock_invoke_messages
 2026-01-14 14:51:50 -08:00
yuneng-jiangandGitHub dcac090de0 Merge pull request #19053 from BerriAI/litellm_intern_user_usage 
[Fix] /team/daily/activity Show Internal Users Their Spend Only
 2026-01-14 13:47:34 -08:00
Ishaan JaffandGitHub 747829dadb [Fix] Claude Code + Bedrock Converse Usage - ensure budget tokens are passed to converse api correctly (#19107) 
* test_bedrock_converse_budget_tokens_preserved

* test_openai_model_with_thinking_converts_to_reasoning_effort

* fix translate_anthropic_thinking_to_reasoning_effort

* test_bedrock_converse_budget_tokens_preserved

* test_anthropic_messages_bedrock_converse_with_thinking
 2026-01-14 12:02:27 -08:00
Rayan PalandGitHub f880ea537f fix(vertex): add type object to tool schemas missing type field (#19103) 
Tools with no parameters (like EnterPlanMode from Anthropic Agents SDK)
send schemas with only $schema and no type field. Gemini rejects these
with "functionDeclaration parameters schema should be of type OBJECT".

Adds type: object when schema has no type and no anyOf/oneOf/allOf.
 2026-01-15 00:43:35 +05:30
Peter GolmandGitHub c215b3a79f fix: preserve llm_provider-* headers in error responses (#19020) 
Extract and preserve provider-specific headers (llm_provider-*) when
handling error responses from LLM providers. This ensures that useful
debugging information from providers is available even when requests
fail with BadRequestError or similar exceptions.
 2026-01-14 22:49:39 +05:30
Sameer KankuteandGitHub cd2d381dd4 Merge pull request #19042 from BerriAI/litellm_staging_01_13_2026 
Staging 01/13/2026
 2026-01-14 21:29:09 +05:30
Sameer KankuteandGitHub 4aadc0d41f Merge pull request #19074 from BerriAI/litellm_19046-bug-retry-policies-are-not-applied-on-responses-calls 
Add retry policy support to responses API
 2026-01-14 17:56:11 +05:30
Sameer KankuteandGitHub 26d8ef734c Merge pull request #19070 from BerriAI/litellm_19066-bug-gemini-image-generation-returns-incorrect-prompt_tokens_details 
Fix: [Bug]: Gemini Image Generation Returns Incorrect prompt_tokens_d…
 2026-01-14 17:55:09 +05:30
Sameer KankuteandGitHub 49d873e894 Merge pull request #19067 from BerriAI/litellm_caching_fix 
Fix: anthropic token counter with thinking
 2026-01-14 17:52:56 +05:30
Sameer KankuteandGitHub b677ea1113 Merge pull request #19064 from BerriAI/litellm_openai_content_none_fix 
Fix: Responses content can't be none
 2026-01-14 17:52:31 +05:30
Sameer Kankute 7dbf09cb12 Fix all 130126 tests 2026-01-14 17:47:03 +05:30
Sameer KankuteandGitHub b4a48f7996 Revert "feat(gemini): add opt-in support for responseJsonSchema (#18147)" 
This reverts commit 4e417f9ef1.
 2026-01-14 17:06:13 +05:30
Sameer KankuteandGitHub ff467c797d Merge pull request #19079 from BerriAI/main 
merge main
 2026-01-14 16:44:31 +05:30
rohan.w.charles bc88dbfbc9 fix: implement mid-stream fallback handling based on user preference 2026-01-14 16:28:51 +05:30
Sameer Kankute 52d3c9dcfc Add retry policy support to responses API 2026-01-14 14:55:17 +05:30
Sameer KankuteandGitHub b2d4f67e17 Merge pull request #19023 from eagle-p/feat/guardrail-clean-error-message 
fix(guardrails): use clean error messages for blocked requests
 2026-01-14 14:03:16 +05:30
Sameer KankuteandGitHub 11cc8dc9d2 Merge pull request #19037 from Jetemple/json-log-fix 
fix: enable JSON logging via configuration and add regression test
 2026-01-14 13:51:36 +05:30
Sameer Kankute 6991342dc4 Fix: [Bug]: Gemini Image Generation Returns Incorrect prompt_tokens_details 2026-01-14 13:47:46 +05:30
Sameer Kankute 333947e236 Add support for caching for responses API 2026-01-14 13:33:07 +05:30
Sameer Kankute 0563ce42a4 Fix: anthropic token counter with thinking 2026-01-14 12:59:23 +05:30
Sameer Kankute 1b34d17935 Fix: Responses content can't be none 2026-01-14 12:13:18 +05:30
YutaSaitoandGitHub 8d204f0a84 Merge pull request #19060 from BerriAI/litellm_fix_anthropic-during-call-error 
[fix] anthropic during call error
 2026-01-14 15:13:09 +09:00
Sameer Kankute 2b13c9aba2 Add tests for openrouter 2026-01-14 10:17:01 +05:30
yuneng-jiangandGitHub 39f56abd8d Merge pull request #18878 from BerriAI/litellm_hakhundov_contribution 
[Fix] Feature Flag for Fix SCIM GET /Users error and enforce SCIM 2.0 compliance
 2026-01-13 20:46:28 -08:00
Yuta Saito 82ed6283fa test: reorganize unified guardrail tests into nested classes 2026-01-14 13:38:43 +09:00