tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-14 08:26:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph
5648 Commits
Author SHA1 Message Date
AndrésandGitHub 9768eca33e fix(azure): add logprobs support for Azure OpenAI GPT-5.2 model (#18856) 
* fix(azure): add logprobs support for Azure OpenAI GPT-5 models

Azure OpenAI GPT-5 models (including gpt-5.2) support logprobs
parameters, unlike OpenAI's GPT-5 reasoning models. This fix
overrides the parent class restriction to enable logprobs for Azure.

Changes:
- Override get_supported_openai_params() in AzureOpenAIGPT5Config
- Add "logprobs" and "top_logprobs" to supported params
- Add comprehensive tests for logprobs functionality

Testing:
- Verified with direct Azure API calls to gpt-5.2
- API version: 2025-01-01-preview
- Successfully returns logprobs data

Related: #7974, #4022

* refactor: restrict logprobs support to gpt-5.2 only

Only gpt-5.2 has been verified to support logprobs on Azure.
Other gpt-5 variants (gpt-5, gpt-5.1) have not been tested.

Changes:
- Add conditional check for is_model_gpt_5_2_model()
- Update tests to be specific to gpt-5.2
- Add negative tests for gpt-5 and gpt-5.1
- Update documentation to reflect gpt-5.2 specificity
 2026-01-09 22:57:50 +05:30
Harshit JainandGitHub 819468554f fix(security): prevent expired key plaintext leak in error response (#18860) 2026-01-09 22:27:39 +05:30
Sameer KankuteandGitHub c0b05fc47a Merge pull request #18250 from sjmatta/claude/fix-issue-17910-QBgDq 
[Fix] Nova model detection for Bedrock provider (#17910)
 2026-01-09 17:30:51 +05:30
Sameer KankuteandGitHub be28fcd463 Merge pull request #18858 from raghav-stripe/raghav-add-bedrock-tokencounter 
feat: add Bedrock as a backend API for token counting
 2026-01-09 17:10:52 +05:30
Sameer KankuteandGitHub e7efd51bd7 Merge branch 'main' into litellm_staging_01_06_2026 2026-01-09 17:06:17 +05:30
Sameer KankuteandGitHub bb9347207b Merge pull request #18833 from BerriAI/litellm_staging_01_08_2026 
Litellm staging 01 08 2026
 2026-01-09 17:04:29 +05:30
Sameer KankuteandGitHub 844c766c65 Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026 
Staging - 01/07/2026
 2026-01-09 17:01:58 +05:30
Sameer Kankute ffa0d6706c Fix: response_format leaking into extra_body 2026-01-09 16:53:35 +05:30
Raghav Jhavar ba78194ff1 add support for bedrock in token counting api 2026-01-09 17:08:07 +07:00
Yuta Saito 5927a557fb tests: add test 2026-01-09 17:25:21 +09:00
Justas Brazauskas c0ee5da444 Fix: Add thought_signatures to VertexGeminiConfig and test 2026-01-09 10:03:45 +02:00
Sameer Kankute c6101ef977 [Bug]: Add Custom CA certificates to boto3 clients 2026-01-09 12:30:36 +05:30
Yuta Saito 022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer KankuteandGitHub d9b275e62a Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support 
[FEAT]: Add support for Vertex AI API keys
 2026-01-09 09:44:36 +05:30
Yuta Saito 48bc5ccb4f fix: test 2026-01-09 11:23:47 +09:00
Yuta Saito f129f598a0 fix: how to execute cloudzero sql 2026-01-09 10:52:48 +09:00
YutaSaitoandGitHub 661f03058c Merge pull request #18802 from BerriAI/litellm_feat_focus_backend 
[feat] Focus export support
 2026-01-09 07:21:04 +09:00
yuneng-jiang 02eec19a1f Merge remote-tracking branch 'origin' into litellm_user_promethus_metrics 2026-01-08 10:39:46 -08:00
yuneng-jiang 1b9c7deec6 Merge remote-tracking branch 'origin' into litellm_key_team_routing_3 2026-01-08 10:39:12 -08:00
yuneng-jiangandGitHub 864e8c6543 Merge pull request #18775 from BerriAI/litellm_fs_callback_fix 
[Fix] Normalize Proxy Config Callback
 2026-01-08 10:37:21 -08:00
Harshit JainandGitHub 516e4f8b96 fix: proactive RDS IAM token refresh to prevent 15-min connection failed (#18795) 
* fix: proactive RDS IAM token refresh to prevent 15-min connection failures (#16220)

* fix: add noqa for PLR0915 in proxy_startup_event
 2026-01-08 23:53:36 +05:30
Cesar GarciaandGitHub 2ef8bbdf6a fix: add xiaomi_mimo to LlmProviders enum to fix router support (#18819) 
Added XIAOMI_MIMO to the LlmProviders enum in types/utils.py.
The provider was already configured in providers.json but was
missing from the enum, causing "Unsupported provider" errors
when using it in Router/Proxy configurations.

Also added comprehensive unit tests to prevent regression.
 2026-01-08 23:45:57 +05:30
Cesar GarciaandGitHub 1c1ee8de46 Mask extra header secrets in model info (#18822) 2026-01-08 23:42:05 +05:30
ChongshunandGitHub 60edf13a21 feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
ConstantineandGitHub 3ebec39b74 fix(proxy): use async anthropic client to prevent event loop blocking (#18435) 
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
 2026-01-08 23:26:46 +05:30
Cesar GarciaandGitHub cfda03ebe1 fix(gemini): support snake_case for google_search tool parameters (#18451) 
* fix(gemini): support snake_case for google_search tool parameters

Add snake_case aliases for Gemini tool names to match the pattern
already used by other tools (url_context, google_maps, code_execution):
- google_search -> googleSearch
- google_search_retrieval -> googleSearchRetrieval
- enterprise_web_search -> enterpriseWebSearch

* test(gemini): add tests for snake_case google_search tool aliases

* refactor(gemini): simplify get_tool_value calls formatting
 2026-01-08 23:25:36 +05:30
Ishaan Jaffer 10ec499369 responses API fixes 2026-01-08 19:16:23 +05:30
Ishaan Jaffer ebf09218d5 TestManusResponsesAPITest 2026-01-08 18:59:46 +05:30
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		b482d336b3 [Feat] New provider - Manus API on /responses, GET /responses (#18804) 
* init ManusResponsesAPIConfig

* init MANUS ApI

* init MANUS create responses

* init MANUS

* test_extract_agent_profile

* transform_get_response_api_request

* test fix

* fixes non stream

* fix streaming

* add MANUSConfig

* test_multiturn_responses_api

* code QA check

* add manus

* Potential fix for code scanning alert no. 3961: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2026-01-08 18:37:42 +05:30
Ishaan Jaffer 58e6ef7d93 TestAzureAIFlux2ImageEdit 2026-01-08 18:23:05 +05:30
Sameer Kankute 5241b27bea fix: test_video_status_basic 2026-01-08 17:30:58 +05:30
Sameer Kankute f5b5073649 fix: test_video_status_async 2026-01-08 17:20:38 +05:30
Sameer Kankute 62d860ea7d fix: litellm/tests/test_litellm/test_responses_id_security.py 2026-01-08 17:01:44 +05:30
Sameer Kankute 0a9861c3ec Fix: test_token_counter_lazy_imports 2026-01-08 16:44:35 +05:30
Sameer Kankute 9d5eb60ff1 Fix: test_text_format_to_text_conversion - properly mock handler to avoid API calls 2026-01-08 16:37:12 +05:30
Sameer Kankute b6e011309a Fix: test_spend_logs_payload_success_log_with_router 2026-01-08 16:07:00 +05:30
Sameer KankuteandGitHub c023c69eae Merge pull request #18739 from BerriAI/litellm_fix_deepinfra_tool_call 
[Fix]: Tool content should be string for Deepinfra
 2026-01-08 15:41:56 +05:30
Sameer KankuteandGitHub c13bc21520 Merge pull request #18754 from BerriAI/litellm_add_annotations_responses_bridge 
Add annotations to completions responses API bridge
 2026-01-08 15:30:16 +05:30
Sameer KankuteandGitHub 0eb20ad500 Merge pull request #18745 from BerriAI/litellm_fix_gemini_audio_file_upload 
Fix: Gemini generate content request with audio file id
 2026-01-08 15:30:09 +05:30
Sameer KankuteandGitHub df7337fd38 Merge pull request #18800 from BerriAI/litellm_add_model_id_support_bedrock 
Add support for model id in bedrock passthrough
 2026-01-08 15:29:47 +05:30
Sameer KankuteandGitHub e0662d53a2 Merge pull request #18799 from BerriAI/litellm_fix_claude_usage_object 
Fix: Incomplete usage in response object passed
 2026-01-08 15:29:26 +05:30
Sameer KankuteandGitHub 4abc94119f Merge pull request #18797 from BerriAI/litellm_bedrock_kimi2_model 
[Feat]Add bedrock kimi2 model support
 2026-01-08 15:29:12 +05:30
Sameer KankuteandGitHub c05e148488 Merge pull request #18809 from BerriAI/main 
merge main
 2026-01-08 15:28:13 +05:30
Sameer KankuteandGitHub c95544959b Merge pull request #18808 from BerriAI/main 
merge main
 2026-01-08 15:25:50 +05:30
Sameer KankuteandGitHub 6941a29ad3 Merge pull request #18807 from BerriAI/main 
merge main
 2026-01-08 15:25:13 +05:30
Sameer Kankute ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito 271ee0959b test: focus 2026-01-08 16:53:09 +09:00
Emerson GomesandGitHub 6c00f6f342 Add support to zai glm-4.7 model in Vertex (#18782) 
* Add support to zai glm-4.7 model in Vertex

* Avoid failed on missing 'created' streaming chunk key
 2026-01-08 13:20:02 +05:30
Sameer Kankute c78bf8cfcd Add support for model id in bedrock passthrough 2026-01-08 13:03:58 +05:30
Sameer Kankute 7e98843d97 Fix: Incomplete usage in response object passed 2026-01-08 10:57:07 +05:30