tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-16 06:23:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph
30881 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuta Saito 844577f2d4 refactor: lazy-load focus export engine and isolate polars deps 2026-01-09 06:39:24 +09:00
yuneng-jiangandGitHub 1d19974737 Merge pull request #18835 from BerriAI/litellm_ui_build_fix_00 
[Infra] Fixing UI Build
 2026-01-08 13:12:56 -08:00
yuneng-jiang 9c93882365 fixing build 2026-01-08 13:03:51 -08:00
yuneng-jiangandGitHub ae26d8e68a Merge pull request #18790 from BerriAI/litellm_key_team_routing_3 
[Feature] Key and Team Router Setting
 2026-01-08 12:41:23 -08:00
Yuta Saito cc3b068f22 fix: mypy error 2026-01-09 05:35:15 +09:00
yuneng-jiang 02eec19a1f Merge remote-tracking branch 'origin' into litellm_user_promethus_metrics 2026-01-08 10:39:46 -08:00
yuneng-jiang 1b9c7deec6 Merge remote-tracking branch 'origin' into litellm_key_team_routing_3 2026-01-08 10:39:12 -08:00
yuneng-jiangandGitHub 864e8c6543 Merge pull request #18775 from BerriAI/litellm_fs_callback_fix 
[Fix] Normalize Proxy Config Callback
 2026-01-08 10:37:21 -08:00
yuneng-jiangandGitHub 8acb9bf366 Merge pull request #18661 from Chesars/litellm_ui_custom_proxy_base_url 
feat(ui): add custom proxy base URL support to Playground
 2026-01-08 10:26:37 -08:00
Harshit JainandGitHub 516e4f8b96 fix: proactive RDS IAM token refresh to prevent 15-min connection failed (#18795) 
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220)

* fix: add noqa for PLR0915 in proxy_startup_event
 2026-01-08 23:53:36 +05:30
Cesar GarciaandGitHub 86b71d4713 fix(workflow): Update issue labeling with working regex pattern (#18821) 
* fix: align max_tokens with max_output_tokens for consistency

Fixed inconsistent max_tokens definitions in model_prices_and_context_window.json.
According to LiteLLM convention, max_tokens should equal max_output_tokens when available.

Models fixed:
- deepseek-chat: 131072 → 8192 (now equals max_output_tokens)
- dashscope/qwen-flash: 1000000 → 32768 (now equals max_output_tokens)
- databricks/databricks-gemma-3-12b: 128000 → 32000 (now equals max_output_tokens)

This ensures consistency across all providers where max_tokens represents
the maximum number of tokens that can be generated in the output.

* fix(workflow): Update issue labeling with working regex pattern

- Replace contains() with regex pattern using \s* for flexible whitespace matching
- Consolidate 4 separate steps into single unified component labeling step
- Tested and verified pattern works for all components: SDK, Proxy, UI Dashboard, Docs
- Pattern handles GitHub's issue body formatting with ### headers and variable newlines
 2026-01-08 23:48:41 +05:30
Cesar GarciaandGitHub 7743c739a3 docs: fix PDF documentation inconsistency in Anthropic page (#18816) 
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
 2026-01-08 23:46:17 +05:30
Cesar GarciaandGitHub 2ef8bbdf6a fix: add xiaomi_mimo to LlmProviders enum to fix router support (#18819) 
Added XIAOMI_MIMO to the LlmProviders enum in types/utils.py.
The provider was already configured in providers.json but was
missing from the enum, causing "Unsupported provider" errors
when using it in Router/Proxy configurations.

Also added comprehensive unit tests to prevent regression.
 2026-01-08 23:45:57 +05:30
Cesar GarciaandGitHub 1c1ee8de46 Mask extra header secrets in model info (#18822) 2026-01-08 23:42:05 +05:30
ChongshunandGitHub 60edf13a21 feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Harshit JainandGitHub 1d296a990c fix: add idx on LOWER(user_email) for faster duplicate email checks log(n) B tree approach (#18828) 2026-01-08 23:36:08 +05:30
Lucas RothmanandGitHub 2a138a202f fix: properly use litellm api keys (#18832) 2026-01-08 23:32:47 +05:30
ConstantineandGitHub 3ebec39b74 fix(proxy): use async anthropic client to prevent event loop blocking (#18435) 
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
 2026-01-08 23:26:46 +05:30
Cesar GarciaandGitHub cfda03ebe1 fix(gemini): support snake_case for google_search tool parameters (#18451) 
* fix(gemini): support snake_case for google_search tool parameters

Add snake_case aliases for Gemini tool names to match the pattern
already used by other tools (url_context, google_maps, code_execution):
- google_search -> googleSearch
- google_search_retrieval -> googleSearchRetrieval
- enterprise_web_search -> enterpriseWebSearch

* test(gemini): add tests for snake_case google_search tool aliases

* refactor(gemini): simplify get_tool_value calls formatting
 2026-01-08 23:25:36 +05:30
Ishaan Jaffer 10ec499369 responses API fixes v1.80.13-nightly 2026-01-08 19:16:23 +05:30
Ishaan Jaffer ebf09218d5 TestManusResponsesAPITest 2026-01-08 18:59:46 +05:30
Ishaan JaffandGitHub cbac70a4ec MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		b482d336b3 [Feat] New provider - Manus API on /responses, GET /responses (#18804) 
* init ManusResponsesAPIConfig

* init MANUS ApI

* init MANUS create responses

* init MANUS

* test_extract_agent_profile

* transform_get_response_api_request

* test fix

* fixes non stream

* fix streaming

* add MANUSConfig

* test_multiturn_responses_api

* code QA check

* add manus

* Potential fix for code scanning alert no. 3961: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2026-01-08 18:37:42 +05:30
Sameer Kankute 3e066db0b5 bump: version 1.80.12 → 1.80.13 2026-01-08 18:34:16 +05:30
Ishaan Jaffer 58e6ef7d93 TestAzureAIFlux2ImageEdit 2026-01-08 18:23:05 +05:30
Sameer KankuteandGitHub 57b2af416a Merge pull request #18811 from BerriAI/litellm_stable_080126 
Fix cicd 080126
 2026-01-08 17:40:19 +05:30
Sameer Kankute 5241b27bea fix: test_video_status_basic 2026-01-08 17:30:58 +05:30
Sameer Kankute f5b5073649 fix: test_video_status_async 2026-01-08 17:20:38 +05:30
Sameer Kankute 2df9d8d4db fix: test_get_request_tags_from_metadata_and_litellm_metadata 2026-01-08 17:08:24 +05:30
Sameer Kankute 62d860ea7d fix: litellm/tests/test_litellm/test_responses_id_security.py 2026-01-08 17:01:44 +05:30
Sameer Kankute 0a9861c3ec Fix: test_token_counter_lazy_imports 2026-01-08 16:44:35 +05:30
Sameer Kankute 9d5eb60ff1 Fix: test_text_format_to_text_conversion - properly mock handler to avoid API calls 2026-01-08 16:37:12 +05:30
Sameer Kankute b6e011309a Fix: test_spend_logs_payload_success_log_with_router 2026-01-08 16:07:00 +05:30
Sameer Kankute 501c2d522b Fix: mypy errors 2026-01-08 15:56:55 +05:30
Sameer KankuteandGitHub c023c69eae Merge pull request #18739 from BerriAI/litellm_fix_deepinfra_tool_call 
[Fix]: Tool content should be string for Deepinfra
 2026-01-08 15:41:56 +05:30
Sameer Kankute f52cc32a4c fix mypy error 2026-01-08 15:38:28 +05:30
Sameer KankuteandGitHub c13bc21520 Merge pull request #18754 from BerriAI/litellm_add_annotations_responses_bridge 
Add annotations to completions responses API bridge
 2026-01-08 15:30:16 +05:30
Sameer KankuteandGitHub 0eb20ad500 Merge pull request #18745 from BerriAI/litellm_fix_gemini_audio_file_upload 
Fix: Gemini generate content request with audio file id
 2026-01-08 15:30:09 +05:30
Sameer KankuteandGitHub df7337fd38 Merge pull request #18800 from BerriAI/litellm_add_model_id_support_bedrock 
Add support for model id in bedrock passthrough
 2026-01-08 15:29:47 +05:30
Sameer KankuteandGitHub e0662d53a2 Merge pull request #18799 from BerriAI/litellm_fix_claude_usage_object 
Fix: Incomplete usage in response object passed
 2026-01-08 15:29:26 +05:30
Sameer KankuteandGitHub 4abc94119f Merge pull request #18797 from BerriAI/litellm_bedrock_kimi2_model 
[Feat]Add bedrock kimi2 model support
 2026-01-08 15:29:12 +05:30
Sameer KankuteandGitHub c05e148488 Merge pull request #18809 from BerriAI/main 
merge main
 2026-01-08 15:28:13 +05:30
Sameer KankuteandGitHub c95544959b Merge pull request #18808 from BerriAI/main 
merge main
 2026-01-08 15:25:50 +05:30
Sameer KankuteandGitHub 6941a29ad3 Merge pull request #18807 from BerriAI/main 
merge main
 2026-01-08 15:25:13 +05:30
Sameer Kankute ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito 790c80070f docs: add FOCUS env 2026-01-08 17:24:51 +09:00
Yuta Saito 93cf2d4848 fix: mypy 2026-01-08 17:19:02 +09:00
Yuta Saito fb00b38fcd chore: lint 2026-01-08 16:56:51 +09:00
Yuta Saito 271ee0959b test: focus 2026-01-08 16:53:09 +09:00
Emerson GomesandGitHub 6c00f6f342 Add support to zai glm-4.7 model in Vertex (#18782) 
* Add support to zai glm-4.7 model in Vertex

* Avoid failed on missing 'created' streaming chunk key
 2026-01-08 13:20:02 +05:30